2024-03-08T21:09:23.504 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-08T21:09:23.504 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173 --owner scheduled_rishabh@teuthology --name rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi --verbose --description fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} -- /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/orig.config.yaml 2024-03-08T21:09:23.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T21:09:23.637 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173 branch: rishabh-2024mar8 description: fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} email: null first_in_suite: false job_id: '7588173' kernel: flavor: default kdb: true sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-2024mar8 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 7d63482aa89628d733e298984a762389b625c761 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7d63482aa89628d733e298984a762389b625c761 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2024mar8 sha1: 7d63482aa89628d733e298984a762389b625c761 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 1249 sha1: 7d63482aa89628d733e298984a762389b625c761 sleep_before_teardown: 0 subset: 481/512 suite: fs suite_branch: rishabh-2024mar8 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7d63482aa89628d733e298984a762389b625c761 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFzhmpaqx9Ga6rr4MqgFLMzouG7pygibGhHYEDeobfgzfDup8t2qKYmiGVgy7ah0fFosDEn+ex7uSea0vKL6J0= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOg+bOf8gOAeVh18+183N9yHnU2HFfayfIdeaJaw8iBQSBziEoIdoooAdK/KszCtLUFyHk7L/7dQ++kzyXcIdNI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-08_19:54:47 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-08T21:09:23.637 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa; will attempt to use it 2024-03-08T21:09:23.637 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks 2024-03-08T21:09:23.638 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-08T21:09:23.639 INFO:teuthology.task.internal:Checking packages... 2024-03-08T21:09:23.663 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7d63482aa89628d733e298984a762389b625c761' 2024-03-08T21:09:23.663 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-08T21:09:23.663 INFO:teuthology.packaging:ref: None 2024-03-08T21:09:23.663 INFO:teuthology.packaging:tag: None 2024-03-08T21:09:23.663 INFO:teuthology.packaging:branch: rishabh-2024mar8 2024-03-08T21:09:23.663 INFO:teuthology.packaging:sha1: 7d63482aa89628d733e298984a762389b625c761 2024-03-08T21:09:23.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-2024mar8 2024-03-08T21:09:24.091 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:09:24.092 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-08T21:09:24.100 INFO:teuthology.task.internal:no buildpackages task found 2024-03-08T21:09:24.100 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-08T21:09:24.112 INFO:teuthology.task.internal:Saving configuration 2024-03-08T21:09:24.128 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-08T21:09:24.147 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T21:09:24.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 21:03:44.971905', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICC7CQxrYgAxRBT3nNFxZeZ+AR1r1gPpS2eTwlsTTqci'} 2024-03-08T21:09:24.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 21:03:44.969949', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMKRtSlxOfB7rOEN0z9hbAIuHdk8vuZ9htyWCj4nnPBc'} 2024-03-08T21:09:24.197 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-08T21:09:24.206 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-08T21:09:24.206 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-08T21:09:24.206 INFO:teuthology.run_tasks:Running task console_log... 2024-03-08T21:09:24.284 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31e0eb70d0>, signals=[15]) 2024-03-08T21:09:24.285 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-08T21:09:24.292 INFO:teuthology.task.internal:Opening connections... 2024-03-08T21:09:24.292 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:09:24.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:09:24.375 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:09:24.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:09:24.459 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-08T21:09:24.467 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-03-08T21:09:24.472 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-03-08T21:09:24.473 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2024-03-08T21:09:24.519 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2024-03-08T21:09:24.520 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-08T21:09:24.520 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-08T21:09:24.520 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-08T21:09:24.520 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-08T21:09:24.520 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2024-03-08T21:09:24.520 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-03-08T21:09:24.544 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-03-08T21:09:24.550 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-03-08T21:09:24.550 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2024-03-08T21:09:24.599 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-08T21:09:24.600 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2024-03-08T21:09:24.601 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-03-08T21:09:24.627 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-08T21:09:24.637 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-08T21:09:24.648 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-08T21:09:24.648 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-03-08T21:09:24.650 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-03-08T21:09:24.655 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-08T21:09:24.663 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-08T21:09:24.663 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-03-08T21:09:24.697 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-03-08T21:09:24.717 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-08T21:09:24.773 INFO:teuthology.run_tasks:Running task kernel... 2024-03-08T21:09:24.787 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'} 2024-03-08T21:09:24.787 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}}, timeout 300 2024-03-08T21:09:24.788 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T21:09:24.788 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T21:09:24.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:09:24.793 DEBUG:teuthology.task.kernel:sha1 for mon.a is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.793 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T21:09:24.793 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-03-08T21:09:24.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:09:24.794 DEBUG:teuthology.task.kernel:sha1 for mon.b is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T21:09:24.795 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-03-08T21:09:24.840 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-56-generic 2024-03-08T21:09:24.840 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.840 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T21:09:24.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout:5.15.0-56-generic 2024-03-08T21:09:24.845 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.845 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T21:09:24.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:09:24.984 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-03-08T21:09:24.984 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-08T21:09:24.989 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-03-08T21:09:24.989 DEBUG:teuthology.orchestra.run.smithi160:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-08T21:09:25.006 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-08T21:09:25.009 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git config --global init.defaultBranch 2024-03-08T21:09:25.150 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2024-03-08T21:09:25.151 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-08T21:09:25.151 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-08T21:09:25.151 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2024-03-08T21:09:25.151 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git branch -m 2024-03-08T21:09:25.151 INFO:teuthology.orchestra.run.smithi119.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-08T21:09:25.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-08T21:09:25.178 INFO:teuthology.orchestra.run.smithi160.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-08T21:09:25.178 INFO:teuthology.orchestra.run.smithi160.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: git config --global init.defaultBranch 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: 2024-03-08T21:09:25.179 INFO:teuthology.orchestra.run.smithi160.stderr:hint: git branch -m 2024-03-08T21:09:25.180 INFO:teuthology.orchestra.run.smithi160.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-08T21:09:25.182 DEBUG:teuthology.orchestra.run.smithi160:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-08T21:09:25.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-08T21:09:25.247 DEBUG:teuthology.orchestra.run.smithi160:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-08T21:09:25.275 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-08T21:09:25.304 DEBUG:teuthology.orchestra.run.smithi160:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-08T21:19:21.884 INFO:teuthology.orchestra.run.smithi160.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-08T21:19:21.885 INFO:teuthology.orchestra.run.smithi160.stderr: * [new branch] main -> origin/main 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190312 -> 20190312 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190416 -> 20190416 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190514 -> 20190514 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190618 -> 20190618 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190717 -> 20190717 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190815 -> 20190815 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20190923 -> 20190923 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20191022 -> 20191022 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20191215 -> 20191215 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200122 -> 20200122 2024-03-08T21:19:21.912 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200316 -> 20200316 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200421 -> 20200421 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200519 -> 20200519 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200619 -> 20200619 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200721 -> 20200721 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200817 -> 20200817 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20200918 -> 20200918 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20201022 -> 20201022 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20201118 -> 20201118 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20201218 -> 20201218 2024-03-08T21:19:21.913 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210208 -> 20210208 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210315 -> 20210315 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210511 -> 20210511 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210716 -> 20210716 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210818 -> 20210818 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20210919 -> 20210919 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20211027 -> 20211027 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20211216 -> 20211216 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220209 -> 20220209 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220310 -> 20220310 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220411 -> 20220411 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220509 -> 20220509 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220610 -> 20220610 2024-03-08T21:19:21.917 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220708 -> 20220708 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220815 -> 20220815 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20220913 -> 20220913 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20221012 -> 20221012 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20221109 -> 20221109 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20221214 -> 20221214 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230117 -> 20230117 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230210 -> 20230210 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230310 -> 20230310 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230404 -> 20230404 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230515 -> 20230515 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230625 -> 20230625 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230804 -> 20230804 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20230919 -> 20230919 2024-03-08T21:19:21.918 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20231030 -> 20231030 2024-03-08T21:19:21.919 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20231111 -> 20231111 2024-03-08T21:19:21.919 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20231211 -> 20231211 2024-03-08T21:19:21.919 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20240115 -> 20240115 2024-03-08T21:19:21.919 INFO:teuthology.orchestra.run.smithi160.stderr: * [new tag] 20240220 -> 20240220 2024-03-08T21:19:26.100 INFO:teuthology.orchestra.run.smithi160.stderr:Updating files: 51% (1833/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 64% (2309/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 78% (2787/3573) Updating files: 78% (2808/3573) Updating files: 79% (2823/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 91% (3252/3573) Updating files: 91% (3271/3573) Updating files: 92% (3288/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-08T21:19:26.105 INFO:teuthology.orchestra.run.smithi160.stdout:HEAD is now at 92010357 Merge branch 'robot/patch-0-1709895245' into 'main' 2024-03-08T21:19:26.127 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on mon.b... 2024-03-08T21:19:26.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:19:26.356 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:19:26.356 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ --input-file=- 2024-03-08T21:19:26.360 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi160.front.sepia.ceph.com to complete... 2024-03-08T21:19:28.105 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08 21:19:28 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb [39270848/39270848] -> "/tmp/linux-image.deb" [1] 2024-03-08T21:19:28.105 INFO:teuthology.orchestra.run.smithi160.stderr:FINISHED --2024-03-08 21:19:28-- 2024-03-08T21:19:28.105 INFO:teuthology.orchestra.run.smithi160.stderr:Total wall clock time: 1.7s 2024-03-08T21:19:28.105 INFO:teuthology.orchestra.run.smithi160.stderr:Downloaded: 1 files, 37M in 1.5s (24.8 MB/s) 2024-03-08T21:19:28.109 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on mon.b... 2024-03-08T21:19:28.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo dpkg -i /tmp/linux-image.deb 2024-03-08T21:19:28.327 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package linux-image-6.8.0-rc7-gdd5c1cd17167. 2024-03-08T21:19:30.308 INFO:teuthology.orchestra.run.smithi160.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-08T21:19:30.313 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-08T21:19:30.465 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-08T21:19:31.787 INFO:teuthology.orchestra.run.smithi119.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-08T21:19:31.788 INFO:teuthology.orchestra.run.smithi119.stderr: * [new branch] main -> origin/main 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190312 -> 20190312 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190416 -> 20190416 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190514 -> 20190514 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190618 -> 20190618 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190717 -> 20190717 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190815 -> 20190815 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190923 -> 20190923 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191022 -> 20191022 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191215 -> 20191215 2024-03-08T21:19:31.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200122 -> 20200122 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200316 -> 20200316 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200421 -> 20200421 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200519 -> 20200519 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200619 -> 20200619 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200721 -> 20200721 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200817 -> 20200817 2024-03-08T21:19:31.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200918 -> 20200918 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201022 -> 20201022 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201118 -> 20201118 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201218 -> 20201218 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210208 -> 20210208 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210315 -> 20210315 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210511 -> 20210511 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210716 -> 20210716 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210818 -> 20210818 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210919 -> 20210919 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211027 -> 20211027 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211216 -> 20211216 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220209 -> 20220209 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220310 -> 20220310 2024-03-08T21:19:31.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220411 -> 20220411 2024-03-08T21:19:31.826 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220509 -> 20220509 2024-03-08T21:19:31.826 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220610 -> 20220610 2024-03-08T21:19:31.826 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220708 -> 20220708 2024-03-08T21:19:31.826 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220815 -> 20220815 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220913 -> 20220913 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221012 -> 20221012 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221109 -> 20221109 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221214 -> 20221214 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230117 -> 20230117 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230210 -> 20230210 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230310 -> 20230310 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230404 -> 20230404 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230515 -> 20230515 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230625 -> 20230625 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230804 -> 20230804 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230919 -> 20230919 2024-03-08T21:19:31.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231030 -> 20231030 2024-03-08T21:19:31.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231111 -> 20231111 2024-03-08T21:19:31.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20231211 -> 20231211 2024-03-08T21:19:31.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20240115 -> 20240115 2024-03-08T21:19:31.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20240220 -> 20240220 2024-03-08T21:19:33.753 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-08T21:19:33.864 INFO:teuthology.orchestra.run.smithi160.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:35.995 INFO:teuthology.orchestra.run.smithi119.stderr:Updating files: 51% (1831/3573) Updating files: 52% (1858/3573) Updating files: 53% (1894/3573) Updating files: 54% (1930/3573) Updating files: 55% (1966/3573) Updating files: 56% (2001/3573) Updating files: 57% (2037/3573) Updating files: 58% (2073/3573) Updating files: 59% (2109/3573) Updating files: 60% (2144/3573) Updating files: 61% (2180/3573) Updating files: 62% (2216/3573) Updating files: 63% (2251/3573) Updating files: 64% (2287/3573) Updating files: 64% (2308/3573) Updating files: 65% (2323/3573) Updating files: 66% (2359/3573) Updating files: 67% (2394/3573) Updating files: 68% (2430/3573) Updating files: 69% (2466/3573) Updating files: 70% (2502/3573) Updating files: 71% (2537/3573) Updating files: 72% (2573/3573) Updating files: 73% (2609/3573) Updating files: 74% (2645/3573) Updating files: 75% (2680/3573) Updating files: 76% (2716/3573) Updating files: 77% (2752/3573) Updating files: 78% (2787/3573) Updating files: 79% (2823/3573) Updating files: 79% (2829/3573) Updating files: 80% (2859/3573) Updating files: 81% (2895/3573) Updating files: 82% (2930/3573) Updating files: 83% (2966/3573) Updating files: 84% (3002/3573) Updating files: 85% (3038/3573) Updating files: 86% (3073/3573) Updating files: 87% (3109/3573) Updating files: 88% (3145/3573) Updating files: 89% (3180/3573) Updating files: 90% (3216/3573) Updating files: 91% (3252/3573) Updating files: 92% (3288/3573) Updating files: 93% (3323/3573) Updating files: 94% (3359/3573) Updating files: 95% (3395/3573) Updating files: 96% (3431/3573) Updating files: 97% (3466/3573) Updating files: 98% (3502/3573) Updating files: 99% (3538/3573) Updating files: 100% (3573/3573) Updating files: 100% (3573/3573), done. 2024-03-08T21:19:36.000 INFO:teuthology.orchestra.run.smithi119.stdout:HEAD is now at 92010357 Merge branch 'robot/patch-0-1709895245' into 'main' 2024-03-08T21:19:36.019 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on mon.a... 2024-03-08T21:19:36.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T21:19:36.232 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:19:36.232 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/ --input-file=- 2024-03-08T21:19:36.234 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2024-03-08T21:19:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08 21:19:37 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-rc7-gdd5c1cd17167/linux-image-6.8.0-rc7-gdd5c1cd17167_6.8.0-rc7-gdd5c1cd17167-1_amd64.deb [39270848/39270848] -> "/tmp/linux-image.deb" [1] 2024-03-08T21:19:37.846 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2024-03-08 21:19:37-- 2024-03-08T21:19:37.847 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 1.5s 2024-03-08T21:19:37.847 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2024-03-08T21:19:37.850 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on mon.a... 2024-03-08T21:19:37.851 DEBUG:teuthology.orchestra.run.smithi119:> sudo dpkg -i /tmp/linux-image.deb 2024-03-08T21:19:38.105 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-6.8.0-rc7-gdd5c1cd17167. 2024-03-08T21:19:40.122 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-08T21:19:40.126 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-08T21:19:40.225 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-08T21:19:43.507 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-6.8.0-rc7-gdd5c1cd17167 (6.8.0-rc7-gdd5c1cd17167-1) ... 2024-03-08T21:19:43.615 INFO:teuthology.orchestra.run.smithi119.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:55.415 INFO:teuthology.orchestra.run.smithi160.stderr:Sourcing file `/etc/default/grub' 2024-03-08T21:19:55.431 INFO:teuthology.orchestra.run.smithi160.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-08T21:19:55.460 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-03-08T21:19:55.787 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:55.806 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:56.148 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-08T21:19:56.163 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-08T21:19:56.231 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-08T21:19:56.236 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-08T21:19:56.429 INFO:teuthology.orchestra.run.smithi160.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-08T21:19:56.430 INFO:teuthology.orchestra.run.smithi160.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-08T21:19:56.430 INFO:teuthology.orchestra.run.smithi160.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-08T21:19:56.473 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-03-08T21:19:56.616 DEBUG:teuthology.orchestra.run.smithi160:> dpkg-deb -c /tmp/linux-image.deb 2024-03-08T21:19:56.668 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./ 2024-03-08T21:19:56.668 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./boot/ 2024-03-08T21:19:56.668 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 4474396 2024-03-06 15:59 ./boot/System.map-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:56.680 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 170903 2024-03-06 15:59 ./boot/config-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:56.680 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11551744 2024-03-06 15:59 ./boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postinst.d/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postrm.d/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/preinst.d/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/prerm.d/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/ 2024-03-08T21:19:56.701 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/ 2024-03-08T21:19:56.702 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:19:56.702 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/ 2024-03-08T21:19:56.702 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/ 2024-03-08T21:19:56.702 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/ 2024-03-08T21:19:56.702 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ 2024-03-08T21:19:56.746 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 490441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-08T21:19:56.923 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T21:19:56.923 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T21:19:56.923 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T21:19:56.923 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 93073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T21:19:56.923 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 106689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 152137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 83849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T21:19:56.924 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/ 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/ 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/ 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpuid.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/msr.ko 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/ 2024-03-08T21:19:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 353961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 886129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 2294353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/af_alg.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_hash.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_skcipher.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T21:19:56.926 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/ 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/ 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T21:19:56.927 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T21:19:56.928 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cryptd.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_simd.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T21:19:56.929 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lrw.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T21:19:56.930 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 143025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xts.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T21:19:56.931 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_extlog.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/ 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/einj.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 104417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ 2024-03-08T21:19:56.932 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 88305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T21:19:56.933 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T21:19:56.934 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_legacy.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T21:19:56.935 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_radisys.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rz1000.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T21:19:56.936 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 83249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T21:19:56.937 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/ 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 124385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/ 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/ 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 113801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/ 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 964745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T21:19:56.938 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 169697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/ 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 94209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 116393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/ 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 110321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 98185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 263633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/ 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 98105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/ 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T21:19:56.939 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/applicom.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/ 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T21:19:56.940 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 148513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 139305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/ 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 84001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T21:19:56.941 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/nvram.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/ 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T21:19:56.942 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/ 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/ 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-palmas.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-si5351.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-twl6040.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-wm831x.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/ 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T21:19:56.943 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 246777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 570217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-08T21:19:56.944 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/ 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/ 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/ 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ 2024-03-08T21:19:56.945 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 122793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T21:19:56.946 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/ 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-gpio.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max14577.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max77693.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max8997.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-palmas.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-08T21:19:56.947 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-08T21:19:56.948 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/ 2024-03-08T21:19:56.948 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/ 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/ 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-arizona.ko 2024-03-08T21:19:56.950 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9052.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9055.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-dln2.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 77745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-generic.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-kempld.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max7300.ko 2024-03-08T21:19:56.951 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max730x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max732x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T21:19:56.952 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-vx855.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/ 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-a4tech.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-apple.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-belkin.ko 2024-03-08T21:19:56.953 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cherry.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-chicony.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 60657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cp2112.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cypress.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ezkey.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T21:19:56.954 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-generic.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kensington.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T21:19:56.955 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lg-g15.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 57969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-magicmouse.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-microsoft.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-monterey.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T21:19:56.956 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ntrig.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T21:19:56.957 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T21:19:56.958 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T21:19:56.959 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 143377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 269209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid.ko 2024-03-08T21:19:56.960 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/ 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 125625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 218865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/ 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 64297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 305385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ 2024-03-08T21:19:56.961 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 97881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T21:19:56.962 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T21:19:56.963 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 99505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T21:19:56.964 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc2103.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 94593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T21:19:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hih6130.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T21:19:56.966 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 140129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/jc42.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T21:19:56.967 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T21:19:56.968 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T21:19:56.969 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 119841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 82713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T21:19:56.970 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 82473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T21:19:56.971 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T21:19:56.972 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 43441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T21:19:56.973 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 79833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 71249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 71225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 119409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-08T21:19:56.974 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/ 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/ 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/ 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-08T21:19:56.975 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-08T21:19:56.976 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T21:19:56.977 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/ 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-08T21:19:56.978 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 273513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 883841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 324233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 97825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 282329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ 2024-03-08T21:19:56.979 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 493129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 420529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 741609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 296785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 153705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/ 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 169089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-08T21:19:56.980 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 266529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 100257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 111329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 128657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 129793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ 2024-03-08T21:19:56.981 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/evbug.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ff-memless.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/ 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/ 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-08T21:19:56.982 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8323.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8333.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt1070.ko 2024-03-08T21:19:56.983 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt2160.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/stowaway.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/matrix-keymap.ko 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/ 2024-03-08T21:19:56.984 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 123177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 335857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/psmouse.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/ 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 109553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T21:19:56.985 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ct82c710.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/parkbd.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/pcips2.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ps2mult.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serport.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T21:19:56.986 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/ 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-88pm860x.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-adp5520.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-bd2802.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da903x.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da9052.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-gpio.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3533.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm355x.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3642.ko 2024-03-08T21:19:56.987 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp8788.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-max8997.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-mc13783.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca9532.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca955x.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca963x.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-tca6507.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm8350.ko 2024-03-08T21:19:56.988 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/ 2024-03-08T21:19:56.989 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/ 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 647033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 93313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bufio.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 155801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 107929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-era.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T21:19:56.990 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-mirror.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 77865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-region-hash.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 109497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-snapshot.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 181761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T21:19:56.991 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-zero.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/ 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 199825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 100833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 126361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 368481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/ 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/ 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 178041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 63233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T21:19:56.992 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 123225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/ 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm800.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm805.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm80x.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona-i2c.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 123625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/bcm590xx.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-08T21:19:56.993 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/dln2.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/janz-cmodio.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/kempld-core.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-core.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lp3943.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/max8907.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/menf21bmc.ko 2024-03-08T21:19:56.994 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/retu-mfd.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/si476x-core.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps65010.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps6507x.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T21:19:56.995 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wm8994.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/ 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/ 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/core.ko 2024-03-08T21:19:56.996 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/ 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ds1682.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/dummy-irq.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/ 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/echo.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/ 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/ 2024-03-08T21:19:56.997 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 152041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hmc6352.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ics932s401.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/ 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T21:19:56.998 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/ 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 125849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 313545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/phantom.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/ 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T21:19:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/ 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 183513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/ 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 491561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/ 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/ 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 105929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T21:19:57.000 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 458969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/ 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 130657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 68777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ 2024-03-08T21:19:57.001 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 64609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/ 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/ 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/ 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/ 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T21:19:57.002 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/ 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 87449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/ 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 97185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 102481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-08T21:19:57.003 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 90185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 81313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/ 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 176689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1434449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 128425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T21:19:57.004 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 131265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 314321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 323681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 193537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 347161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1045321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T21:19:57.005 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 166129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 204185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T21:19:57.006 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 141153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/ 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 60665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/ 2024-03-08T21:19:57.007 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 281193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/ 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 90297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-08T21:19:57.008 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 295673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 584297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 245977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 944449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 288481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/ 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 514337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T21:19:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 93465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 734689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 151649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 86985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/ 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 102433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T21:19:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 122601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/ 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 727377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 278825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1121537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-08T21:19:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 95569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 151193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 136793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/ 2024-03-08T21:19:57.012 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/ 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 227841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 87009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 671985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/ 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T21:19:57.013 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/ 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 83801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 194057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/ 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 104001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/ 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1066817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/ 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T21:19:57.014 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/ 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/ 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 68041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/ 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-08T21:19:57.015 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 495641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/ 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 103177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 166041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/ 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/ 2024-03-08T21:19:57.016 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 92337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/ 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 79993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 83713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/ 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/ 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/ 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/defxx.ko 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/ 2024-03-08T21:19:57.017 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 217025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/ 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 237241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/ 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 85841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/ 2024-03-08T21:19:57.018 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/ 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T21:19:57.019 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T21:19:57.020 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 81953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 76561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 99001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/ 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 43761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/plip.ko 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ 2024-03-08T21:19:57.021 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sb1000.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/ 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T21:19:57.022 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 64617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/ 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 107225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 86881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/ 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 144345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T21:19:57.023 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 307233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 143993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 267721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 103353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/ 2024-03-08T21:19:57.024 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 131297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 85209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/ 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/ 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pci-stub.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/ 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T21:19:57.025 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 146129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 112785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/ 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/ 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/ 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/ 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/ 2024-03-08T21:19:57.026 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/ 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/ 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T21:19:57.027 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 131937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-08T21:19:57.028 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/ 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T21:19:57.029 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/ 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9030_battery.ko 2024-03-08T21:19:57.030 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9052-battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/gpio-charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max14577_charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max17042_battery.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8903_charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8925_power.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-08T21:19:57.031 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/sbs-battery.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/test_power.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_power.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm8350_power.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/ 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/ 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/ 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T21:19:57.032 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/ 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9052.ko 2024-03-08T21:19:57.033 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9055.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9063.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 68473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T21:19:57.034 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8907.ko 2024-03-08T21:19:57.035 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8925.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8997.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8998.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-palmas.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T21:19:57.036 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-08T21:19:57.037 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 77521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 57713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 135249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/ 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 271385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T21:19:57.038 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 100529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/ 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 356833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 295953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/ 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 189089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/ 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T21:19:57.039 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/ 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 246913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/ 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1171857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/ 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 238369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/ 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 115305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/ 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 308905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T21:19:57.040 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/ 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 76033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 146809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 75969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/ 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 212329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 60497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T21:19:57.041 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/ 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 157713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fdomain.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/ 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 294881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 201721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/imm.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 43969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T21:19:57.042 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 265937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/ 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 317129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/ 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 315337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 145489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/ 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 216345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T21:19:57.043 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/ 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 2193953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/ 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 310665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 85513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/ 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 659585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/ 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 119465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T21:19:57.044 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/ 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 81545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/ 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 366305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 124593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ppa.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/ 2024-03-08T21:19:57.045 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1876657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 85185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/ 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 558897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qlogicfas408.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 261073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 173921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 280105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 97617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T21:19:57.046 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 115705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 164865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/xen-scsifront.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 129345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T21:19:57.047 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/ 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/ 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 736665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/ 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 931433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T21:19:57.048 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 122481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/ 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 75497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/ 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/ 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T21:19:57.049 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-08T21:19:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 57769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/moxa.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/mxser.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/ 2024-03-08T21:19:57.051 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/ 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_uart.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/ 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 101969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/rp2.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/ 2024-03-08T21:19:57.052 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 545377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/ 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_mf624.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_netx.ko 2024-03-08T21:19:57.053 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/ 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/ 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 145753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-08T21:19:57.054 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/ 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 87001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ulpi.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/ 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/ 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-08T21:19:57.055 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 452785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/ 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/ 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 60321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 92401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-08T21:19:57.056 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 50937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 122241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 57625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 85505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/ 2024-03-08T21:19:57.057 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-08T21:19:57.058 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 161193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/ 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 157593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 69609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 75961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-08T21:19:57.059 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 73009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 65873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 65993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 81401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 156321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 87249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T21:19:57.060 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811_cs.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/ 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cytherm.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ehset.ko 2024-03-08T21:19:57.061 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/lvstest.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/ 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 64737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T21:19:57.062 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbtest.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/ 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/usbmon.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/ 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 301593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-08T21:19:57.063 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/ 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T21:19:57.064 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/f81232.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 175097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 136977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 124737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T21:19:57.065 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 107425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/metro-usb.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 78121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mxuport.ko 2024-03-08T21:19:57.066 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 191817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T21:19:57.067 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 125513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usbserial.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ 2024-03-08T21:19:57.068 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 52753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T21:19:57.069 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 180281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/ 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 71001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 104041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/ 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/ 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 162841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T21:19:57.070 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 103649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 76433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/ 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 113657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 57993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/ 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/ 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-08T21:19:57.071 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/bd6107.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-08T21:19:57.072 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/ 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-08T21:19:57.073 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/ 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T21:19:57.074 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 103025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/acquirewdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/advantechwdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-08T21:19:57.075 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/dw_wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T21:19:57.076 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T21:19:57.077 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/retu_wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-08T21:19:57.078 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/ 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T21:19:57.079 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/ 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 176337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 71145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-scsiback.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/ 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/ 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 158217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/ 2024-03-08T21:19:57.080 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/adfs.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/ 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 163433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/ 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1019049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/kafs.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/ 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 103185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/autofs4.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/ 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 64585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/ 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 41001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/bfs.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T21:19:57.081 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 3487249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 305841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1335369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 97713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/configfs.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/ 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T21:19:57.082 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 644161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/efs.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1527625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/freevxfs.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/ 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T21:19:57.083 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1231233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 141625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 223177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 193481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/hpfs.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/ 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 420329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T21:19:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 281617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 88897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 490409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 81433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/ 2024-03-08T21:19:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 117361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1058273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv2.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 120169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 2041705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/ 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/ 2024-03-08T21:19:57.086 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1511641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T21:19:57.139 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/ 2024-03-08T21:19:57.139 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 582409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/ 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T21:19:57.140 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ascii.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T21:19:57.141 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T21:19:57.142 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 94033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 142569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 165641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 118017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T21:19:57.143 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T21:19:57.144 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 220457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ntfs.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 244633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 440633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 2590681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T21:19:57.145 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/ 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/omfs.ko 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/ 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 360897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 56929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T21:19:57.146 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/ 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/qnx4.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/ 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 46601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/qnx6.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/ 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_tree.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v1.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v2.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/ 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 532161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/ 2024-03-08T21:19:57.147 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 2712385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 134705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 91281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/ 2024-03-08T21:19:57.148 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 248329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 162737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/ 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 4035417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/ 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/ 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 80481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/locktorture.ko 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/ 2024-03-08T21:19:57.149 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/test_udelay.ko 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 60257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc7.ko 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/ 2024-03-08T21:19:57.150 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/interval_tree_test.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/ 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/ 2024-03-08T21:19:57.154 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/memory-notifier-error-inject.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/notifier-error-inject.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/percpu_test.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/pm-notifier-error-inject.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/ 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 143257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/rbtree_test.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/ 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-kstrtox.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-string_helpers.ko 2024-03-08T21:19:57.155 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 4863217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_bpf.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_firmware.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_module.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_user_copy.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/ 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/xz_dec_test.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/ 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T21:19:57.156 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/ 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/ 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T21:19:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/ 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 82865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/ 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 198809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T21:19:57.158 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/ 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 667353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/ 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 790545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T21:19:57.159 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T21:19:57.160 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/ 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1046689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/ 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 125761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/ 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 194441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T21:19:57.161 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 58737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/ 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 390033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/ 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 102033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/hsr.ko 2024-03-08T21:19:57.162 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 284665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 47873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 51209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T21:19:57.163 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 61505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-08T21:19:57.164 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T21:19:57.165 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T21:19:57.166 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T21:19:57.167 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 45041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 79921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_gre.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 94161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T21:19:57.168 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 54265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/mip6.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T21:19:57.169 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T21:19:57.170 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 74873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T21:19:57.171 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/ 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 84457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/ 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 125201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 25809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T21:19:57.172 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 53225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/ 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/lapb.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/ 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 268449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc2.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/ 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 309361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/ 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T21:19:57.173 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 119689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 99985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 100273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 102545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 102337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 111665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T21:19:57.174 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 59185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 112137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 112401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 110329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 113281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 412433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T21:19:57.175 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T21:19:57.176 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 411665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 118081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 108305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T21:19:57.177 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 92217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 96489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T21:19:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 44129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 623337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 42569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 22929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 40753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T21:19:57.179 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_osf.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T21:19:57.180 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_synproxy.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tproxy.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 89225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/x_tables.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T21:19:57.181 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T21:19:57.182 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T21:19:57.183 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 43193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T21:19:57.184 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T21:19:57.185 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 29993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 16809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T21:19:57.186 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 8449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpudp.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/ 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 14433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/ 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 12329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/ 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 384137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T21:19:57.187 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/ 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/ 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 112521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/phonet.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/pn_pep.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/ 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 253945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 165049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T21:19:57.188 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 68129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/ 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 828145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/rxrpc.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/ 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 37081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 43409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T21:19:57.189 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 19177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_cgroup.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 39513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 62649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 13313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T21:19:57.190 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 33417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 34649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq_codel.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 35449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 49841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 66441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T21:19:57.191 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 30217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 36145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 27401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 24769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 48529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 32809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 26785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 31313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T21:19:57.192 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 28265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/ 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 932785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/ 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/ 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 336969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 55009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 1513769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/ 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 704697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/ 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T21:19:57.193 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 867121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/ 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/ 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 87737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 67937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 98089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 11073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/ 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 131209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/x25.ko 2024-03-08T21:19:57.194 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/ 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_algo.ko 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 20545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 105209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_user.ko 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/ 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/ 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 15433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 642283 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 625640 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 7677 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 23498 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 9916 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 70732 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T21:19:57.195 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 147214 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 233213 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 210 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 72614 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 879 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 257955 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 312782 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/ 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/ 2024-03-08T21:19:57.196 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/ 2024-03-08T21:19:57.197 INFO:teuthology.orchestra.run.smithi160.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:19:57.197 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 173 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/changelog.Debian.gz 2024-03-08T21:19:57.197 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r-- root/root 691 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/copyright 2024-03-08T21:19:57.202 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:57.203 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:57.203 DEBUG:teuthology.orchestra.run.smithi160:> egrep '(submenu|menuentry.*6.8.0-rc7-gdd5c1cd17167).*{' /boot/grub/grub.cfg 2024-03-08T21:19:57.210 INFO:teuthology.orchestra.run.smithi160.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:19:57.210 INFO:teuthology.orchestra.run.smithi160.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:19:57.210 INFO:teuthology.orchestra.run.smithi160.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:19:57.211 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-08T21:19:57.211 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:57.211 DEBUG:teuthology.orchestra.run.smithi160:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-08T21:19:57.254 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi160.front.sepia.ceph.com to complete... 2024-03-08T21:19:57.689 INFO:teuthology.orchestra.run.smithi160.stderr:Sourcing file `/etc/default/grub' 2024-03-08T21:19:57.689 INFO:teuthology.orchestra.run.smithi160.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-08T21:19:57.706 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-03-08T21:19:57.885 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:57.892 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:19:58.167 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-08T21:19:58.172 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-08T21:19:58.212 INFO:teuthology.orchestra.run.smithi160.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-08T21:19:58.218 INFO:teuthology.orchestra.run.smithi160.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-08T21:19:58.377 INFO:teuthology.orchestra.run.smithi160.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-08T21:19:58.377 INFO:teuthology.orchestra.run.smithi160.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-08T21:19:58.377 INFO:teuthology.orchestra.run.smithi160.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-08T21:19:58.399 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-03-08T21:20:04.438 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2024-03-08T21:20:04.455 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-08T21:20:04.479 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-03-08T21:20:04.769 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:04.789 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.089 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-08T21:20:05.096 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-08T21:20:05.158 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-08T21:20:05.164 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-08T21:20:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-08T21:20:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-08T21:20:05.304 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-08T21:20:05.338 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-03-08T21:20:05.491 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-deb -c /tmp/linux-image.deb 2024-03-08T21:20:05.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./ 2024-03-08T21:20:05.499 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./boot/ 2024-03-08T21:20:05.499 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4474396 2024-03-06 15:59 ./boot/System.map-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.511 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 170903 2024-03-06 15:59 ./boot/config-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.512 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11551744 2024-03-06 15:59 ./boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.531 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postinst.d/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/postrm.d/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/preinst.d/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./etc/kernel/prerm.d/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/ 2024-03-08T21:20:05.532 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/ 2024-03-08T21:20:05.533 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ 2024-03-08T21:20:05.533 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T21:20:05.536 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/ 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/ 2024-03-08T21:20:05.537 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/ 2024-03-08T21:20:05.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T21:20:05.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpuid.ko 2024-03-08T21:20:05.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/msr.ko 2024-03-08T21:20:05.538 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/ 2024-03-08T21:20:05.538 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 353961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T21:20:05.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 886129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T21:20:05.539 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2294353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/af_alg.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_hash.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/algif_skcipher.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/ 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/ 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T21:20:05.619 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T21:20:05.620 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cryptd.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_simd.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lrw.ko 2024-03-08T21:20:05.621 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T21:20:05.622 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xts.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_extlog.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/ 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/apei/einj.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T21:20:05.623 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T21:20:05.624 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_legacy.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T21:20:05.625 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_radisys.ko 2024-03-08T21:20:05.626 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rz1000.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T21:20:05.627 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/ 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/ 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/ 2024-03-08T21:20:05.628 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/ 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 964745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 169697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/ 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 116393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/ 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T21:20:05.629 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/ 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/ 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/applicom.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/ 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T21:20:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 148513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 139305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/ 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/nvram.ko 2024-03-08T21:20:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/ 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/ 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-08T21:20:05.632 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-palmas.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-si5351.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-twl6040.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/clk/clk-wm831x.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/ 2024-03-08T21:20:05.633 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 570217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/ 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/ 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ 2024-03-08T21:20:05.634 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/ 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T21:20:05.635 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/ 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-gpio.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max14577.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max77693.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-max8997.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-palmas.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/ 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-08T21:20:05.636 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/ 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/ 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-arizona.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9052.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-da9055.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-dln2.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-generic.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-08T21:20:05.637 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-kempld.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max7300.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max730x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-max732x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-08T21:20:05.638 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-vx855.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/ 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-a4tech.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-apple.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-belkin.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cherry.ko 2024-03-08T21:20:05.639 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-chicony.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cp2112.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-cypress.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ezkey.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-generic.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T21:20:05.640 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kensington.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lg-g15.ko 2024-03-08T21:20:05.641 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-magicmouse.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-microsoft.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-monterey.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ntrig.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T21:20:05.642 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T21:20:05.643 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T21:20:05.644 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 269209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/ 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-08T21:20:05.645 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 218865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/ 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 305385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T21:20:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T21:20:05.647 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc2103.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T21:20:05.648 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hih6130.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T21:20:05.649 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 140129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/jc42.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T21:20:05.650 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T21:20:05.651 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T21:20:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T21:20:05.653 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T21:20:05.654 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T21:20:05.655 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/ 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/ 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/ 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T21:20:05.656 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T21:20:05.657 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-08T21:20:05.658 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/ 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ 2024-03-08T21:20:05.659 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 273513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 883841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 324233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 282329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 493129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/ 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 420529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/ 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 741609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T21:20:05.660 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 296785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 153705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 169089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 266529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ 2024-03-08T21:20:05.661 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/evbug.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/ff-memless.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/ 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/ 2024-03-08T21:20:05.662 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8323.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/lm8333.ko 2024-03-08T21:20:05.663 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt1070.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/qt2160.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/stowaway.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-08T21:20:05.664 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/matrix-keymap.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/ 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 335857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/psmouse.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/ 2024-03-08T21:20:05.665 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ct82c710.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/parkbd.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/pcips2.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/ps2mult.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serport.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/ 2024-03-08T21:20:05.666 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-88pm860x.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-adp5520.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-bd2802.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da903x.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-da9052.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-gpio.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3533.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm355x.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3642.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp8788.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-max8997.ko 2024-03-08T21:20:05.667 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-mc13783.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca9532.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca955x.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-pca963x.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-tca6507.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-wm8350.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T21:20:05.668 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/ 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/ 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 647033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bufio.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 155801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T21:20:05.669 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-era.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-mirror.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-region-hash.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 109497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-snapshot.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 181761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T21:20:05.670 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-zero.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/ 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 199825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 126361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 368481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/ 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/ 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 178041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T21:20:05.671 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/ 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm800.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm805.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/88pm80x.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona-i2c.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/arizona.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/bcm590xx.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/dln2.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/janz-cmodio.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/kempld-core.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-core.ko 2024-03-08T21:20:05.672 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lp3943.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/max8907.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/menf21bmc.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/pcf50633.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/retu-mfd.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/si476x-core.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps65010.ko 2024-03-08T21:20:05.673 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/tps6507x.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wm8994.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ad525x_dpot.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/ 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T21:20:05.674 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/ 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/c2port/core.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/ 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ds1682.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/dummy-irq.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/ 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/echo/echo.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/ 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T21:20:05.675 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/ 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hmc6352.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ics932s401.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/ 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T21:20:05.676 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/ 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 313545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/phantom.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/ 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/ 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 183513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T21:20:05.677 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/ 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 491561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/ 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/ 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 458969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T21:20:05.678 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/ 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/ 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T21:20:05.679 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-08T21:20:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/ 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-08T21:20:05.681 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1434449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T21:20:05.758 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 314321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 323681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 347161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T21:20:05.759 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1045321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 204185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T21:20:05.760 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/ 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/ 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 281193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T21:20:05.761 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 584297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 245977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 944449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-08T21:20:05.762 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 288481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T21:20:05.763 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/ 2024-03-08T21:20:05.763 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 514337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T21:20:05.763 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-08T21:20:05.763 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T21:20:05.763 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-08T21:20:05.765 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 734689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 151649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/ 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/ 2024-03-08T21:20:05.766 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 727377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 278825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1121537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-08T21:20:05.767 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/ 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 151193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/ 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/ 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/ 2024-03-08T21:20:05.768 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 227841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 671985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/ 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/ 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 194057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T21:20:05.769 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1066817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/ 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T21:20:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/ 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 495641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/ 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T21:20:05.771 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/ 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/ 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/ 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/ 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T21:20:05.772 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/defxx.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 217025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 237241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ 2024-03-08T21:20:05.773 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/ 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T21:20:05.774 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/ 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T21:20:05.775 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T21:20:05.776 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/ 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/plip/plip.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sb1000.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/ 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T21:20:05.777 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/ 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/ 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 144345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T21:20:05.778 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 307233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/ 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T21:20:05.779 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/ 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/ 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pci-stub.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/ 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T21:20:05.780 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/ 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-08T21:20:05.781 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T21:20:05.782 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/ 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T21:20:05.783 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/ 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9030_battery.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/da9052-battery.ko 2024-03-08T21:20:05.784 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/gpio-charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max14577_charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max17042_battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8903_charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/max8925_power.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/sbs-battery.ko 2024-03-08T21:20:05.785 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/test_power.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm831x_power.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/power/supply/wm8350_power.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/ 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/ 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/ 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T21:20:05.786 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/ 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9052.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9055.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-da9063.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T21:20:05.787 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-08T21:20:05.788 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8907.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8925.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8997.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max8998.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-palmas.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-08T21:20:05.789 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T21:20:05.790 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 135249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/ 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 271385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/ 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 356833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/ 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-08T21:20:05.791 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1171857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 238369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/ 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 308905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T21:20:05.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/ 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/ 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 212329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/ 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fdomain.ko 2024-03-08T21:20:05.793 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/ 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 294881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 201721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/imm.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 265937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/ 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 317129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/ 2024-03-08T21:20:05.794 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 315337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/ 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/ 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2193953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/ 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/ 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 659585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/ 2024-03-08T21:20:05.795 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/ 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/ 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 366305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ppa.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/ 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1876657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T21:20:05.796 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/ 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 558897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qlogicfas408.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 261073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 280105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T21:20:05.797 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 164865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/xen-scsifront.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/ 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/ 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 736665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/ 2024-03-08T21:20:05.798 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 931433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/ 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/ 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/ 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T21:20:05.799 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T21:20:05.800 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/moxa.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/mxser.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/ 2024-03-08T21:20:05.801 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/ 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/altera_uart.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/ 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/rp2.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/ 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 545377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T21:20:05.802 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/ 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_mf624.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_netx.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/ 2024-03-08T21:20:05.803 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/ 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/ 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T21:20:05.804 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/common/ulpi.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/ 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/ 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 452785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/ 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/ 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-08T21:20:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/ 2024-03-08T21:20:05.806 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-08T21:20:05.807 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 161193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/ 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-08T21:20:05.808 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 156321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811_cs.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/ 2024-03-08T21:20:05.809 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/cytherm.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ehset.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T21:20:05.810 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/lvstest.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/ 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T21:20:05.811 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbtest.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/ 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/mon/usbmon.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/ 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 301593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/ 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-08T21:20:05.812 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/f81232.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 175097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T21:20:05.813 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107425 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/metro-usb.ko 2024-03-08T21:20:05.814 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mxuport.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 191817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T21:20:05.815 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usbserial.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ 2024-03-08T21:20:05.816 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T21:20:05.817 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 180281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/ 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/ 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/ 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/ 2024-03-08T21:20:05.818 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/ 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/ 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/bd6107.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-08T21:20:05.819 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/ 2024-03-08T21:20:05.820 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/ 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T21:20:05.821 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/acquirewdt.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/advantechwdt.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-08T21:20:05.822 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/dw_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T21:20:05.823 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/retu_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T21:20:05.824 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21473 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T21:20:05.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-scsiback.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 158217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/ 2024-03-08T21:20:05.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/adfs/adfs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 163433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1019049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/afs/kafs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/autofs/autofs4.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64585 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/bfs/bfs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/ 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 3487249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T21:20:05.827 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 305841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1335369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/configfs/configfs.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 644161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/ 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/efs/efs.ko 2024-03-08T21:20:05.828 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1527625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/freevxfs/freevxfs.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1231233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/ 2024-03-08T21:20:05.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 223177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hpfs/hpfs.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 420329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 281617 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/ 2024-03-08T21:20:05.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/ 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/ 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/ 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1058273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv2.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 120169 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2041705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/ 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T21:20:05.831 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/ 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1511641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/ 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 582409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/ 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13065 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T21:20:05.832 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ascii.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T21:20:05.833 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T21:20:05.834 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T21:20:05.835 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 220457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ntfs/ntfs.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 244633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 440633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T21:20:05.836 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2590681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/ 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53681 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/omfs/omfs.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/ 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 360897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T21:20:05.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx4/qnx4.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46601 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/qnx6/qnx6.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_tree.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v1.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/quota/quota_v2.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 532161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/ 2024-03-08T21:20:05.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2712385 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 134705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 91281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 248329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/ 2024-03-08T21:20:05.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4035417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/ 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/ 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/locking/locktorture.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/ 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/time/test_udelay.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc7.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/ 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T21:20:05.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/interval_tree_test.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/ 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/ 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/memory-notifier-error-inject.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/notifier-error-inject.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/percpu_test.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/pm-notifier-error-inject.ko 2024-03-08T21:20:05.882 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/ 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/rbtree_test.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/ 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-kstrtox.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test-string_helpers.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4863217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_bpf.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_firmware.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_module.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/test_user_copy.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T21:20:05.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/ 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/xz/xz_dec_test.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/ 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/ 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6953 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T21:20:05.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/ 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/ 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/ 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 198809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/ 2024-03-08T21:20:05.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 667353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/ 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 790545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T21:20:05.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T21:20:05.887 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/ 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1046689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/ 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/ 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 194441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/ 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 390033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13353 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12593 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T21:20:05.888 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/ 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/hsr/hsr.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 284665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48233 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61505 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T21:20:05.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9577 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14777 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-08T21:20:05.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T21:20:05.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15961 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10849 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T21:20:05.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_gre.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/mip6.ko 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ 2024-03-08T21:20:05.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16105 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T21:20:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15017 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8905 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/ 2024-03-08T21:20:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/ 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125201 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/ 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48097 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/lapb/lapb.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/ 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 268449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc2.ko 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/ 2024-03-08T21:20:05.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 309361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/ 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28609 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100273 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T21:20:05.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113281 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 412433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T21:20:05.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10633 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9257 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13537 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7713 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 411665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15873 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T21:20:05.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17289 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T21:20:05.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 96489 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 623337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30153 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T21:20:05.901 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49641 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40753 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9497 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20025 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14321 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11745 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_osf.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T21:20:05.902 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9977 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12833 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_synproxy.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tproxy.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/x_tables.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7625 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T21:20:05.903 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T21:20:05.904 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8225 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11113 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11249 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13345 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T21:20:05.905 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10881 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7761 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10561 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11817 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11689 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T21:20:05.906 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7897 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11721 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10001 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11889 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9377 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T21:20:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8161 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13297 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29993 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8705 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15673 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpudp.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11033 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9305 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/ 2024-03-08T21:20:05.908 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/ 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12329 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/ 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 384137 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/ 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13465 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/ 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112521 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/phonet.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55041 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/phonet/pn_pep.ko 2024-03-08T21:20:05.909 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/ 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 253945 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165049 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68129 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/ 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 828145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rxrpc/rxrpc.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/ 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23481 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23369 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43409 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T21:20:05.910 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20185 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35193 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36569 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33865 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19177 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_cgroup.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7457 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33417 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T21:20:05.911 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7913 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10921 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21665 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20857 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34649 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31513 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq_codel.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35449 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49841 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66441 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30217 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T21:20:05.912 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10801 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26081 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36145 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27401 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10657 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48529 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31313 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28265 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/ 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 932785 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20241 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T21:20:05.913 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 336969 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55009 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1513769 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 704697 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10393 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 867121 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15929 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/ 2024-03-08T21:20:05.914 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87737 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67937 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98089 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11073 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17809 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/ 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/x25/x25.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/ 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23057 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_algo.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20545 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105209 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_user.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/ 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/ 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15433 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T21:20:05.915 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 642283 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 625640 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7677 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23498 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9916 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70732 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 147214 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 233213 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 210 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72614 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 257955 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 312782 2024-03-06 15:59 ./lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T21:20:05.916 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/ 2024-03-08T21:20:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/ 2024-03-08T21:20:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/ 2024-03-08T21:20:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/ 2024-03-08T21:20:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/changelog.Debian.gz 2024-03-08T21:20:05.917 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 691 2024-03-06 15:59 ./usr/share/doc/linux-image-6.8.0-rc7-gdd5c1cd17167/copyright 2024-03-08T21:20:05.922 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.922 INFO:teuthology.task.kernel:searching for kernel 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.922 DEBUG:teuthology.orchestra.run.smithi119:> egrep '(submenu|menuentry.*6.8.0-rc7-gdd5c1cd17167).*{' /boot/grub/grub.cfg 2024-03-08T21:20:05.929 INFO:teuthology.orchestra.run.smithi119.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:20:05.929 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:20:05.929 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-rc7-gdd5c1cd17167-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-08T21:20:05.929 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-08T21:20:05.930 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:05.930 DEBUG:teuthology.orchestra.run.smithi119:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-08T21:20:05.975 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi119.front.sepia.ceph.com to complete... 2024-03-08T21:20:06.359 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2024-03-08T21:20:06.360 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-08T21:20:06.370 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-03-08T21:20:06.578 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:06.584 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:20:06.820 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-08T21:20:06.825 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-08T21:20:06.868 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-08T21:20:06.873 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-08T21:20:07.012 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-08T21:20:07.012 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-08T21:20:07.012 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-08T21:20:07.022 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-03-08T21:20:08.158 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-08T21:20:29.534 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-08T21:20:29.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:20:29.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:20:38.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-08T21:20:38.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:20:38.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:20:47.903 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-03-08T21:20:56.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-08T21:20:56.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:20:56.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:20:59.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-03-08T21:21:05.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:21:05.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:21:08.673 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-08T21:21:11.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:21:11.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:21:20.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:21:20.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:21:30.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-03-08T21:21:39.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-08T21:21:45.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:21:45.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:21:46.037 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-03-08T21:21:46.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:21:46.973 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T21:21:46.973 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-03-08T21:21:47.024 INFO:teuthology.orchestra.run.smithi160.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:21:47.025 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:21:47.025 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T21:21:47.025 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-08T21:21:48.025 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-08T21:21:48.026 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-08T21:21:48.151 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-03-08T21:21:48.264 DEBUG:teuthology.parallel:result is None 2024-03-08T21:21:54.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:21:54.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:21:54.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-03-08T21:22:12.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:22:12.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:22:12.335 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-03-08T21:22:12.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:22:12.892 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T21:22:12.892 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-03-08T21:22:12.941 INFO:teuthology.orchestra.run.smithi119.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:22:12.941 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T21:22:12.941 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T21:22:12.942 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-08T21:22:13.942 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-08T21:22:13.942 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-08T21:22:14.043 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-03-08T21:22:14.089 DEBUG:teuthology.parallel:result is None 2024-03-08T21:22:14.090 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-08T21:22:14.101 INFO:teuthology.task.internal:Creating test directory... 2024-03-08T21:22:14.101 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T21:22:14.104 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T21:22:14.114 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-08T21:22:14.142 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-08T21:22:14.164 INFO:teuthology.task.internal:Creating archive directory... 2024-03-08T21:22:14.164 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T21:22:14.167 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T21:22:14.207 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-08T21:22:14.215 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-08T21:22:14.215 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T21:22:14.253 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T21:22:14.277 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T21:22:14.279 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T21:22:14.291 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T21:22:14.293 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T21:22:14.296 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-08T21:22:14.305 INFO:teuthology.task.internal:Configuring sudo... 2024-03-08T21:22:14.306 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T21:22:14.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T21:22:14.361 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-08T21:22:14.373 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-08T21:22:14.373 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T21:22:14.405 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T21:22:14.414 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T21:22:14.462 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T21:22:14.514 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:22:14.514 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T21:22:14.589 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T21:22:14.598 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T21:22:14.650 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:22:14.650 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T21:22:14.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-03-08T21:22:14.725 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-03-08T21:22:14.835 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-08T21:22:14.842 INFO:teuthology.task.internal:Starting timer... 2024-03-08T21:22:14.843 INFO:teuthology.run_tasks:Running task pcp... 2024-03-08T21:22:14.926 INFO:teuthology.run_tasks:Running task selinux... 2024-03-08T21:22:14.981 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2024-03-08T21:22:14.981 DEBUG:teuthology.task.selinux:Excluding smithi160: OS 'ubuntu' does not support SELinux 2024-03-08T21:22:14.982 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-08T21:22:14.982 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-08T21:22:14.982 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-08T21:22:14.982 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-08T21:22:15.017 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-08T21:22:15.036 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-08T21:22:15.037 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi119.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-08T21:29:50.540 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-03-08T21:29:50.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:29:50.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:29:50.626 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-03-08T21:29:50.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-03-08T21:29:50.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:29:50.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T21:29:50.839 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-03-08T21:29:50.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-03-08T21:29:50.973 INFO:teuthology.run_tasks:Running task clock... 2024-03-08T21:29:50.984 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-08T21:29:50.984 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T21:29:50.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T21:29:50.988 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T21:29:50.988 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Command line: ntpd -gq 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: ---------------------------------------------------- 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: ntp-4 is maintained by Network Time Foundation, 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: corporation. Support and training for ntp-4 are 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: available at https://www.nwtime.org/support 2024-03-08T21:29:51.023 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: ---------------------------------------------------- 2024-03-08T21:29:51.024 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: proto: precision = 0.042 usec (-24) 2024-03-08T21:29:51.024 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: basedate set to 2022-02-04 2024-03-08T21:29:51.024 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: gps base set to 2022-02-06 (week 2196) 2024-03-08T21:29:51.025 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-08T21:29:51.025 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-08T21:29:51.025 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: restrict ::: KOD does nothing without LIMITED. 2024-03-08T21:29:51.026 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen and drop on 0 v6wildcard [::]:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen normally on 2 lo 127.0.0.1:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen normally on 4 lo [::1]:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2024-03-08T21:29:51.027 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:51 ntpd[17175]: Listening on routing socket on fd #22 for interface updates 2024-03-08T21:29:51.053 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-08T21:29:51.053 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Command line: ntpd -gq 2024-03-08T21:29:51.053 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: ---------------------------------------------------- 2024-03-08T21:29:51.053 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: ntp-4 is maintained by Network Time Foundation, 2024-03-08T21:29:51.054 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-08T21:29:51.054 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: corporation. Support and training for ntp-4 are 2024-03-08T21:29:51.054 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: available at https://www.nwtime.org/support 2024-03-08T21:29:51.054 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: ---------------------------------------------------- 2024-03-08T21:29:51.054 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: proto: precision = 0.040 usec (-24) 2024-03-08T21:29:51.055 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: basedate set to 2022-02-04 2024-03-08T21:29:51.055 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: gps base set to 2022-02-06 (week 2196) 2024-03-08T21:29:51.055 INFO:teuthology.orchestra.run.smithi160.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-08T21:29:51.055 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-08T21:29:51.055 INFO:teuthology.orchestra.run.smithi160.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-08T21:29:51.056 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: restrict ::: KOD does nothing without LIMITED. 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen and drop on 0 v6wildcard [::]:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen normally on 2 lo 127.0.0.1:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen normally on 3 enp3s0f1 172.21.15.160:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen normally on 4 lo [::1]:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f5b%5]:123 2024-03-08T21:29:51.057 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:51 ntpd[17141]: Listening on routing socket on fd #22 for interface updates 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:52.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:52 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:53.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:53 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:54.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:54 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:54.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:54 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:55.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:55 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:55.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:55 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:56.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:56.026 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.027 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.027 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:56.027 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:56 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:56.056 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:56.056 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:56.056 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:56.056 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:56.056 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:56 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:57.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:57 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:57.053 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:57.053 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:57.053 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:57.053 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:57.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:57.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:57 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:58.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:58.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:58 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:58.054 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:58.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:58.055 INFO:teuthology.orchestra.run.smithi160.stdout: 8 Mar 21:29:58 ntpd[17141]: ntpd: time slew +0.001308 s 2024-03-08T21:29:58.055 INFO:teuthology.orchestra.run.smithi160.stdout:ntpd: time slew +0.001308s 2024-03-08T21:29:58.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-08T21:29:58.055 INFO:teuthology.orchestra.run.smithi160.stderr: 8 Mar 21:29:58 ntpd[17141]: can't open /var/log/ntpstats/loopstats.20240308: Permission denied 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout: remote refid st t when poll reach delay offset jitter 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout:============================================================================== 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:58.149 INFO:teuthology.orchestra.run.smithi160.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240308: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240308: Permission denied 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stdout: 8 Mar 21:29:59 ntpd[17175]: ntpd: time slew +0.000081 s 2024-03-08T21:29:59.024 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew +0.000081s 2024-03-08T21:29:59.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-08T21:29:59.025 INFO:teuthology.orchestra.run.smithi119.stderr: 8 Mar 21:29:59 ntpd[17175]: can't open /var/log/ntpstats/loopstats.20240308: Permission denied 2024-03-08T21:29:59.144 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-03-08T21:29:59.145 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-03-08T21:29:59.145 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:59.145 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:59.145 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:59.145 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:29:59.146 INFO:teuthology.run_tasks:Running task install... 2024-03-08T21:29:59.154 DEBUG:teuthology.task.install:project ceph 2024-03-08T21:29:59.154 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}} 2024-03-08T21:29:59.155 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'} 2024-03-08T21:29:59.155 INFO:teuthology.task.install:Using flavor: default 2024-03-08T21:29:59.161 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-08T21:29:59.161 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-08T21:29:59.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2024-03-08T21:29:59.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo apt-key list | grep Ceph 2024-03-08T21:29:59.265 INFO:teuthology.orchestra.run.smithi160.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-08T21:29:59.292 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-08T21:29:59.315 INFO:teuthology.orchestra.run.smithi160.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-08T21:29:59.315 INFO:teuthology.orchestra.run.smithi160.stdout:uid [ unknown] Ceph.com (release key) 2024-03-08T21:29:59.317 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-08T21:29:59.317 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-08T21:29:59.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T21:29:59.342 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-08T21:29:59.342 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2024-03-08T21:29:59.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-08T21:29:59.343 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-08T21:29:59.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T21:29:59.457 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default/ 2024-03-08T21:29:59.458 INFO:teuthology.task.install.deb:Package version is 19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:29:59.725 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default/ 2024-03-08T21:29:59.726 INFO:teuthology.task.install.deb:Package version is 19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:29:59.752 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:29:59.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-08T21:29:59.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo apt-get update 2024-03-08T21:30:00.002 INFO:teuthology.orchestra.run.smithi160.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy InRelease 2024-03-08T21:30:00.020 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:30:00.020 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-08T21:30:00.025 INFO:teuthology.orchestra.run.smithi160.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-08T21:30:00.026 INFO:teuthology.orchestra.run.smithi160.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-08T21:30:00.040 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-03-08T21:30:00.047 INFO:teuthology.orchestra.run.smithi160.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-08T21:30:00.069 INFO:teuthology.orchestra.run.smithi160.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-08T21:30:00.079 INFO:teuthology.orchestra.run.smithi160.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-08T21:30:00.101 INFO:teuthology.orchestra.run.smithi160.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2024-03-08T21:30:00.152 INFO:teuthology.orchestra.run.smithi160.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-08T21:30:00.233 INFO:teuthology.orchestra.run.smithi160.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-08T21:30:00.347 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-08T21:30:00.347 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-08T21:30:00.418 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-08T21:30:00.435 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy InRelease 2024-03-08T21:30:00.499 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-08T21:30:00.500 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-08T21:30:00.566 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-08T21:30:00.605 INFO:teuthology.orchestra.run.smithi160.stdout:Fetched 28.9 kB in 1s (47.0 kB/s) 2024-03-08T21:30:00.630 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-08T21:30:00.777 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,397 B] 2024-03-08T21:30:00.930 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.9 kB in 1s (42.9 kB/s) 2024-03-08T21:30:01.551 INFO:teuthology.orchestra.run.smithi160.stdout:Reading package lists... 2024-03-08T21:30:01.565 DEBUG:teuthology.orchestra.run.smithi160:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1965-g7d63482a-1jammy cephadm=19.0.0-1965-g7d63482a-1jammy ceph-mds=19.0.0-1965-g7d63482a-1jammy ceph-mgr=19.0.0-1965-g7d63482a-1jammy ceph-common=19.0.0-1965-g7d63482a-1jammy ceph-fuse=19.0.0-1965-g7d63482a-1jammy ceph-test=19.0.0-1965-g7d63482a-1jammy ceph-volume=19.0.0-1965-g7d63482a-1jammy radosgw=19.0.0-1965-g7d63482a-1jammy python3-rados=19.0.0-1965-g7d63482a-1jammy python3-rgw=19.0.0-1965-g7d63482a-1jammy python3-cephfs=19.0.0-1965-g7d63482a-1jammy python3-rbd=19.0.0-1965-g7d63482a-1jammy libcephfs2=19.0.0-1965-g7d63482a-1jammy libcephfs-dev=19.0.0-1965-g7d63482a-1jammy librados2=19.0.0-1965-g7d63482a-1jammy librbd1=19.0.0-1965-g7d63482a-1jammy rbd-fuse=19.0.0-1965-g7d63482a-1jammy python3-cephfs=19.0.0-1965-g7d63482a-1jammy cephfs-shell=19.0.0-1965-g7d63482a-1jammy cephfs-top=19.0.0-1965-g7d63482a-1jammy cephfs-mirror=19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:30:01.638 INFO:teuthology.orchestra.run.smithi160.stdout:Reading package lists... 2024-03-08T21:30:01.807 INFO:teuthology.orchestra.run.smithi160.stdout:Building dependency tree... 2024-03-08T21:30:01.807 INFO:teuthology.orchestra.run.smithi160.stdout:Reading state information... 2024-03-08T21:30:01.873 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-03-08T21:30:01.887 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1965-g7d63482a-1jammy cephadm=19.0.0-1965-g7d63482a-1jammy ceph-mds=19.0.0-1965-g7d63482a-1jammy ceph-mgr=19.0.0-1965-g7d63482a-1jammy ceph-common=19.0.0-1965-g7d63482a-1jammy ceph-fuse=19.0.0-1965-g7d63482a-1jammy ceph-test=19.0.0-1965-g7d63482a-1jammy ceph-volume=19.0.0-1965-g7d63482a-1jammy radosgw=19.0.0-1965-g7d63482a-1jammy python3-rados=19.0.0-1965-g7d63482a-1jammy python3-rgw=19.0.0-1965-g7d63482a-1jammy python3-cephfs=19.0.0-1965-g7d63482a-1jammy python3-rbd=19.0.0-1965-g7d63482a-1jammy libcephfs2=19.0.0-1965-g7d63482a-1jammy libcephfs-dev=19.0.0-1965-g7d63482a-1jammy librados2=19.0.0-1965-g7d63482a-1jammy librbd1=19.0.0-1965-g7d63482a-1jammy rbd-fuse=19.0.0-1965-g7d63482a-1jammy python3-cephfs=19.0.0-1965-g7d63482a-1jammy cephfs-shell=19.0.0-1965-g7d63482a-1jammy cephfs-top=19.0.0-1965-g7d63482a-1jammy cephfs-mirror=19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:30:01.959 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-03-08T21:30:01.965 INFO:teuthology.orchestra.run.smithi160.stdout:The following packages were automatically installed and are no longer required: 2024-03-08T21:30:01.965 INFO:teuthology.orchestra.run.smithi160.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-08T21:30:01.965 INFO:teuthology.orchestra.run.smithi160.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-08T21:30:01.965 INFO:teuthology.orchestra.run.smithi160.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-08T21:30:01.966 INFO:teuthology.orchestra.run.smithi160.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-08T21:30:01.966 INFO:teuthology.orchestra.run.smithi160.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-08T21:30:01.966 INFO:teuthology.orchestra.run.smithi160.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout:The following additional packages will be installed: 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-08T21:30:01.968 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-08T21:30:01.969 INFO:teuthology.orchestra.run.smithi160.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout:Suggested packages: 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout:Recommended packages: 2024-03-08T21:30:01.970 INFO:teuthology.orchestra.run.smithi160.stdout: btrfs-tools 2024-03-08T21:30:02.120 INFO:teuthology.orchestra.run.smithi160.stdout:The following NEW packages will be installed: 2024-03-08T21:30:02.120 INFO:teuthology.orchestra.run.smithi160.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-08T21:30:02.120 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-08T21:30:02.120 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-08T21:30:02.121 INFO:teuthology.orchestra.run.smithi160.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-08T21:30:02.122 INFO:teuthology.orchestra.run.smithi160.stdout: socat unzip xmlstarlet zip 2024-03-08T21:30:02.126 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-03-08T21:30:02.127 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-03-08T21:30:02.283 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-03-08T21:30:02.283 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-08T21:30:02.283 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-08T21:30:02.283 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-08T21:30:02.283 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-08T21:30:02.284 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-08T21:30:02.284 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-08T21:30:02.285 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-03-08T21:30:02.285 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-08T21:30:02.285 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-08T21:30:02.285 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-08T21:30:02.285 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-08T21:30:02.286 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-08T21:30:02.286 INFO:teuthology.orchestra.run.smithi119.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-08T21:30:02.287 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-08T21:30:02.288 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-03-08T21:30:02.289 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2024-03-08T21:30:02.362 INFO:teuthology.orchestra.run.smithi160.stdout:0 upgraded, 124 newly installed, 0 to remove and 278 not upgraded. 2024-03-08T21:30:02.362 INFO:teuthology.orchestra.run.smithi160.stdout:Need to get 177 MB of archives. 2024-03-08T21:30:02.362 INFO:teuthology.orchestra.run.smithi160.stdout:After this operation, 732 MB of additional disk space will be used. 2024-03-08T21:30:02.362 INFO:teuthology.orchestra.run.smithi160.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1965-g7d63482a-1jammy [3,538 kB] 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-03-08T21:30:02.437 INFO:teuthology.orchestra.run.smithi119.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-08T21:30:02.438 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-03-08T21:30:02.439 INFO:teuthology.orchestra.run.smithi119.stdout: socat unzip xmlstarlet zip 2024-03-08T21:30:02.589 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 124 newly installed, 0 to remove and 278 not upgraded. 2024-03-08T21:30:02.589 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 177 MB of archives. 2024-03-08T21:30:02.589 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 732 MB of additional disk space will be used. 2024-03-08T21:30:02.589 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-08T21:30:02.641 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-08T21:30:02.673 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-08T21:30:02.776 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1965-g7d63482a-1jammy [3,538 kB] 2024-03-08T21:30:02.795 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-08T21:30:02.855 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-08T21:30:02.861 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-08T21:30:02.895 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-08T21:30:02.901 INFO:teuthology.orchestra.run.smithi160.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-08T21:30:02.984 INFO:teuthology.orchestra.run.smithi160.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-08T21:30:03.030 INFO:teuthology.orchestra.run.smithi160.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-08T21:30:03.055 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-08T21:30:03.057 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-08T21:30:03.064 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-08T21:30:03.067 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-08T21:30:03.067 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-08T21:30:03.091 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-08T21:30:03.093 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-08T21:30:03.095 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-08T21:30:03.096 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-08T21:30:03.097 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-08T21:30:03.131 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-08T21:30:03.135 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-08T21:30:03.137 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-08T21:30:03.138 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-08T21:30:03.138 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-08T21:30:03.140 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-08T21:30:03.140 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-08T21:30:03.169 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-08T21:30:03.169 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-08T21:30:03.170 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-08T21:30:03.203 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-08T21:30:03.203 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-08T21:30:03.209 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-08T21:30:03.210 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-08T21:30:03.210 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-08T21:30:03.211 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-08T21:30:03.212 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-08T21:30:03.234 INFO:teuthology.orchestra.run.smithi160.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-08T21:30:03.243 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-08T21:30:03.244 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-08T21:30:03.245 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-08T21:30:03.280 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-08T21:30:03.280 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-08T21:30:03.292 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-08T21:30:03.292 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-08T21:30:03.293 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-08T21:30:03.293 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-08T21:30:03.295 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-08T21:30:03.321 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-08T21:30:03.322 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-08T21:30:03.327 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-08T21:30:03.330 INFO:teuthology.orchestra.run.smithi160.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-08T21:30:03.344 INFO:teuthology.orchestra.run.smithi160.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-08T21:30:03.369 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-08T21:30:03.373 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-08T21:30:03.375 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-08T21:30:03.375 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-08T21:30:03.381 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-08T21:30:03.395 INFO:teuthology.orchestra.run.smithi160.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-08T21:30:03.574 INFO:teuthology.orchestra.run.smithi160.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-08T21:30:03.583 INFO:teuthology.orchestra.run.smithi160.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-08T21:30:03.598 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-08T21:30:03.599 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-08T21:30:03.600 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-08T21:30:03.601 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-08T21:30:03.602 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-08T21:30:03.611 INFO:teuthology.orchestra.run.smithi160.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-08T21:30:03.620 INFO:teuthology.orchestra.run.smithi160.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-08T21:30:03.620 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-08T21:30:03.623 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-08T21:30:03.623 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-08T21:30:03.652 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-08T21:30:03.652 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-08T21:30:03.664 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-08T21:30:03.665 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-08T21:30:03.665 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-08T21:30:03.666 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-08T21:30:03.666 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-08T21:30:03.667 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-08T21:30:03.673 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-08T21:30:03.692 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-08T21:30:03.693 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-08T21:30:03.694 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-08T21:30:03.729 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-08T21:30:03.733 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-08T21:30:03.734 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-08T21:30:03.735 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-08T21:30:03.735 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-08T21:30:03.740 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-08T21:30:03.741 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-08T21:30:03.765 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-08T21:30:03.765 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-08T21:30:03.765 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-08T21:30:03.800 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-08T21:30:03.802 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-08T21:30:03.803 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-08T21:30:03.814 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-08T21:30:03.814 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-08T21:30:03.814 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-08T21:30:03.817 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-08T21:30:03.836 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-08T21:30:04.086 INFO:teuthology.orchestra.run.smithi160.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-08T21:30:04.475 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1965-g7d63482a-1jammy [3,220 kB] 2024-03-08T21:30:04.670 INFO:teuthology.orchestra.run.smithi160.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-08T21:30:04.685 INFO:teuthology.orchestra.run.smithi160.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-08T21:30:04.700 INFO:teuthology.orchestra.run.smithi160.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-08T21:30:04.709 INFO:teuthology.orchestra.run.smithi160.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-08T21:30:04.710 INFO:teuthology.orchestra.run.smithi160.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-08T21:30:04.726 INFO:teuthology.orchestra.run.smithi160.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-08T21:30:04.764 INFO:teuthology.orchestra.run.smithi160.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-08T21:30:04.776 INFO:teuthology.orchestra.run.smithi160.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-08T21:30:04.781 INFO:teuthology.orchestra.run.smithi160.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-08T21:30:04.781 INFO:teuthology.orchestra.run.smithi160.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-08T21:30:04.953 INFO:teuthology.orchestra.run.smithi160.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-08T21:30:05.036 INFO:teuthology.orchestra.run.smithi160.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-08T21:30:05.055 INFO:teuthology.orchestra.run.smithi160.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-08T21:30:05.118 INFO:teuthology.orchestra.run.smithi160.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-08T21:30:05.155 INFO:teuthology.orchestra.run.smithi160.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-08T21:30:05.176 INFO:teuthology.orchestra.run.smithi160.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-08T21:30:05.202 INFO:teuthology.orchestra.run.smithi160.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-08T21:30:05.226 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1965-g7d63482a-1jammy [709 kB] 2024-03-08T21:30:05.297 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1965-g7d63482a-1jammy [356 kB] 2024-03-08T21:30:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1965-g7d63482a-1jammy [32.8 kB] 2024-03-08T21:30:05.357 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1965-g7d63482a-1jammy [180 kB] 2024-03-08T21:30:05.373 INFO:teuthology.orchestra.run.smithi160.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-08T21:30:05.389 INFO:teuthology.orchestra.run.smithi160.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-08T21:30:05.395 INFO:teuthology.orchestra.run.smithi160.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-08T21:30:05.400 INFO:teuthology.orchestra.run.smithi160.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-08T21:30:05.412 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1965-g7d63482a-1jammy [64.6 kB] 2024-03-08T21:30:05.414 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1965-g7d63482a-1jammy [330 kB] 2024-03-08T21:30:05.425 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1965-g7d63482a-1jammy [6,575 kB] 2024-03-08T21:30:05.585 INFO:teuthology.orchestra.run.smithi160.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-08T21:30:05.592 INFO:teuthology.orchestra.run.smithi160.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1965-g7d63482a-1jammy [3,220 kB] 2024-03-08T21:30:05.667 INFO:teuthology.orchestra.run.smithi160.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-08T21:30:05.683 INFO:teuthology.orchestra.run.smithi160.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-08T21:30:05.869 INFO:teuthology.orchestra.run.smithi160.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-08T21:30:05.920 INFO:teuthology.orchestra.run.smithi160.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-08T21:30:05.932 INFO:teuthology.orchestra.run.smithi160.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-08T21:30:06.091 INFO:teuthology.orchestra.run.smithi160.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-08T21:30:06.091 INFO:teuthology.orchestra.run.smithi160.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-08T21:30:06.098 INFO:teuthology.orchestra.run.smithi160.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-08T21:30:06.101 INFO:teuthology.orchestra.run.smithi160.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-08T21:30:06.115 INFO:teuthology.orchestra.run.smithi160.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-08T21:30:06.196 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1965-g7d63482a-1jammy [112 kB] 2024-03-08T21:30:06.197 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1965-g7d63482a-1jammy [467 kB] 2024-03-08T21:30:06.263 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1965-g7d63482a-1jammy [24.2 MB] 2024-03-08T21:30:06.300 INFO:teuthology.orchestra.run.smithi160.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-08T21:30:06.554 INFO:teuthology.orchestra.run.smithi160.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-08T21:30:06.687 INFO:teuthology.orchestra.run.smithi160.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-08T21:30:06.731 INFO:teuthology.orchestra.run.smithi160.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-08T21:30:06.821 INFO:teuthology.orchestra.run.smithi160.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-08T21:30:06.831 INFO:teuthology.orchestra.run.smithi160.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-08T21:30:06.844 INFO:teuthology.orchestra.run.smithi160.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-08T21:30:06.887 INFO:teuthology.orchestra.run.smithi160.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-08T21:30:07.154 INFO:teuthology.orchestra.run.smithi160.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-08T21:30:07.155 INFO:teuthology.orchestra.run.smithi160.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-08T21:30:07.157 INFO:teuthology.orchestra.run.smithi160.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-08T21:30:07.322 INFO:teuthology.orchestra.run.smithi160.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-08T21:30:07.665 INFO:teuthology.orchestra.run.smithi160.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-08T21:30:08.074 INFO:teuthology.orchestra.run.smithi160.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-08T21:30:08.083 INFO:teuthology.orchestra.run.smithi160.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-08T21:30:08.084 INFO:teuthology.orchestra.run.smithi160.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-08T21:30:08.139 INFO:teuthology.orchestra.run.smithi160.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1965-g7d63482a-1jammy [709 kB] 2024-03-08T21:30:08.159 INFO:teuthology.orchestra.run.smithi160.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-08T21:30:08.159 INFO:teuthology.orchestra.run.smithi160.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-08T21:30:08.160 INFO:teuthology.orchestra.run.smithi160.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-08T21:30:08.161 INFO:teuthology.orchestra.run.smithi160.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-08T21:30:08.162 INFO:teuthology.orchestra.run.smithi160.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-08T21:30:08.163 INFO:teuthology.orchestra.run.smithi160.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-08T21:30:08.328 INFO:teuthology.orchestra.run.smithi160.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-08T21:30:08.412 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1965-g7d63482a-1jammy [5,081 kB] 2024-03-08T21:30:08.537 INFO:teuthology.orchestra.run.smithi160.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-08T21:30:08.673 INFO:teuthology.orchestra.run.smithi160.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1965-g7d63482a-1jammy [356 kB] 2024-03-08T21:30:08.796 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1965-g7d63482a-1jammy [243 kB] 2024-03-08T21:30:08.802 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1965-g7d63482a-1jammy [124 kB] 2024-03-08T21:30:08.807 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1965-g7d63482a-1jammy [1,522 kB] 2024-03-08T21:30:08.838 INFO:teuthology.orchestra.run.smithi160.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1965-g7d63482a-1jammy [32.8 kB] 2024-03-08T21:30:08.841 INFO:teuthology.orchestra.run.smithi160.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1965-g7d63482a-1jammy [180 kB] 2024-03-08T21:30:08.864 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1965-g7d63482a-1jammy [6,251 kB] 2024-03-08T21:30:08.866 INFO:teuthology.orchestra.run.smithi160.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-08T21:30:08.901 INFO:teuthology.orchestra.run.smithi160.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1965-g7d63482a-1jammy [64.6 kB] 2024-03-08T21:30:08.913 INFO:teuthology.orchestra.run.smithi160.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-08T21:30:08.929 INFO:teuthology.orchestra.run.smithi160.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1965-g7d63482a-1jammy [330 kB] 2024-03-08T21:30:08.940 INFO:teuthology.orchestra.run.smithi160.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-08T21:30:08.949 INFO:teuthology.orchestra.run.smithi160.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-08T21:30:08.995 INFO:teuthology.orchestra.run.smithi160.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-08T21:30:09.021 INFO:teuthology.orchestra.run.smithi160.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1965-g7d63482a-1jammy [6,575 kB] 2024-03-08T21:30:09.021 INFO:teuthology.orchestra.run.smithi160.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-08T21:30:09.023 INFO:teuthology.orchestra.run.smithi160.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-08T21:30:09.030 INFO:teuthology.orchestra.run.smithi160.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-08T21:30:09.034 INFO:teuthology.orchestra.run.smithi160.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-08T21:30:09.101 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1965-g7d63482a-1jammy [22.8 MB] 2024-03-08T21:30:09.229 INFO:teuthology.orchestra.run.smithi160.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-08T21:30:09.490 INFO:teuthology.orchestra.run.smithi160.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-08T21:30:09.761 INFO:teuthology.orchestra.run.smithi160.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-08T21:30:09.763 INFO:teuthology.orchestra.run.smithi160.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-08T21:30:09.779 INFO:teuthology.orchestra.run.smithi160.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-08T21:30:09.785 INFO:teuthology.orchestra.run.smithi160.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-08T21:30:09.824 INFO:teuthology.orchestra.run.smithi160.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-08T21:30:09.838 INFO:teuthology.orchestra.run.smithi160.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-08T21:30:09.930 INFO:teuthology.orchestra.run.smithi160.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-08T21:30:09.931 INFO:teuthology.orchestra.run.smithi160.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-08T21:30:09.932 INFO:teuthology.orchestra.run.smithi160.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-08T21:30:09.971 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1965-g7d63482a-1jammy [14.0 kB] 2024-03-08T21:30:09.971 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1965-g7d63482a-1jammy [867 kB] 2024-03-08T21:30:09.996 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1965-g7d63482a-1jammy [2,191 kB] 2024-03-08T21:30:10.083 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1965-g7d63482a-1jammy [777 kB] 2024-03-08T21:30:10.111 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1965-g7d63482a-1jammy [144 kB] 2024-03-08T21:30:10.112 INFO:teuthology.orchestra.run.smithi160.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-08T21:30:10.117 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1965-g7d63482a-1jammy [1,934 kB] 2024-03-08T21:30:10.192 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1965-g7d63482a-1jammy [8,625 kB] 2024-03-08T21:30:10.377 INFO:teuthology.orchestra.run.smithi160.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-08T21:30:10.529 INFO:teuthology.orchestra.run.smithi119.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1965-g7d63482a-1jammy [14.2 kB] 2024-03-08T21:30:10.529 INFO:teuthology.orchestra.run.smithi119.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1965-g7d63482a-1jammy [50.0 MB] 2024-03-08T21:30:10.847 INFO:teuthology.orchestra.run.smithi160.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1965-g7d63482a-1jammy [112 kB] 2024-03-08T21:30:10.878 INFO:teuthology.orchestra.run.smithi160.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1965-g7d63482a-1jammy [467 kB] 2024-03-08T21:30:10.983 INFO:teuthology.orchestra.run.smithi160.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1965-g7d63482a-1jammy [24.2 MB] 2024-03-08T21:30:12.518 INFO:teuthology.orchestra.run.smithi119.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1965-g7d63482a-1jammy [121 kB] 2024-03-08T21:30:12.519 INFO:teuthology.orchestra.run.smithi119.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1965-g7d63482a-1jammy [228 kB] 2024-03-08T21:30:12.521 INFO:teuthology.orchestra.run.smithi119.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1965-g7d63482a-1jammy [33.9 kB] 2024-03-08T21:30:12.522 INFO:teuthology.orchestra.run.smithi119.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1965-g7d63482a-1jammy [23.4 kB] 2024-03-08T21:30:12.522 INFO:teuthology.orchestra.run.smithi119.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1965-g7d63482a-1jammy [38.4 kB] 2024-03-08T21:30:12.523 INFO:teuthology.orchestra.run.smithi119.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1965-g7d63482a-1jammy [13.0 MB] 2024-03-08T21:30:13.051 INFO:teuthology.orchestra.run.smithi119.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1965-g7d63482a-1jammy [91.5 kB] 2024-03-08T21:30:13.678 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 177 MB in 11s (16.7 MB/s) 2024-03-08T21:30:13.814 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-08T21:30:13.879 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-08T21:30:13.883 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-08T21:30:13.921 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-08T21:30:14.224 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-08T21:30:14.237 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-08T21:30:14.299 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-08T21:30:14.539 INFO:teuthology.orchestra.run.smithi160.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1965-g7d63482a-1jammy [5,081 kB] 2024-03-08T21:30:14.618 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2024-03-08T21:30:14.632 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-08T21:30:14.668 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-08T21:30:14.977 INFO:teuthology.orchestra.run.smithi160.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1965-g7d63482a-1jammy [243 kB] 2024-03-08T21:30:14.996 INFO:teuthology.orchestra.run.smithi160.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1965-g7d63482a-1jammy [124 kB] 2024-03-08T21:30:15.005 INFO:teuthology.orchestra.run.smithi160.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1965-g7d63482a-1jammy [1,522 kB] 2024-03-08T21:30:15.013 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-08T21:30:15.026 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-08T21:30:15.122 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-08T21:30:15.138 INFO:teuthology.orchestra.run.smithi160.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1965-g7d63482a-1jammy [6,251 kB] 2024-03-08T21:30:15.417 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-08T21:30:15.430 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-08T21:30:15.467 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-08T21:30:15.642 INFO:teuthology.orchestra.run.smithi160.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1965-g7d63482a-1jammy [22.8 MB] 2024-03-08T21:30:15.811 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-08T21:30:15.824 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-08T21:30:15.870 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-08T21:30:16.315 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-08T21:30:16.328 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:16.380 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:16.751 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-08T21:30:16.765 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:16.801 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:17.129 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-08T21:30:17.143 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:17.187 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:17.240 INFO:teuthology.orchestra.run.smithi160.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1965-g7d63482a-1jammy [14.0 kB] 2024-03-08T21:30:17.241 INFO:teuthology.orchestra.run.smithi160.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1965-g7d63482a-1jammy [867 kB] 2024-03-08T21:30:17.294 INFO:teuthology.orchestra.run.smithi160.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1965-g7d63482a-1jammy [2,191 kB] 2024-03-08T21:30:17.435 INFO:teuthology.orchestra.run.smithi160.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1965-g7d63482a-1jammy [777 kB] 2024-03-08T21:30:17.480 INFO:teuthology.orchestra.run.smithi160.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1965-g7d63482a-1jammy [144 kB] 2024-03-08T21:30:17.482 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-08T21:30:17.496 INFO:teuthology.orchestra.run.smithi160.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1965-g7d63482a-1jammy [1,934 kB] 2024-03-08T21:30:17.496 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-08T21:30:17.540 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-08T21:30:17.606 INFO:teuthology.orchestra.run.smithi160.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1965-g7d63482a-1jammy [8,625 kB] 2024-03-08T21:30:17.852 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2024-03-08T21:30:17.866 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-librados2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:17.930 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:18.141 INFO:teuthology.orchestra.run.smithi160.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1965-g7d63482a-1jammy [14.2 kB] 2024-03-08T21:30:18.141 INFO:teuthology.orchestra.run.smithi160.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1965-g7d63482a-1jammy [50.0 MB] 2024-03-08T21:30:18.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2024-03-08T21:30:18.719 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-librbd1_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:18.763 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:19.193 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2024-03-08T21:30:19.207 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:19.251 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:19.520 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2024-03-08T21:30:19.534 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:19.578 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-08T21:30:19.912 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2024-03-08T21:30:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:20.293 INFO:teuthology.orchestra.run.smithi160.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1965-g7d63482a-1jammy [121 kB] 2024-03-08T21:30:20.294 INFO:teuthology.orchestra.run.smithi160.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1965-g7d63482a-1jammy [228 kB] 2024-03-08T21:30:20.296 INFO:teuthology.orchestra.run.smithi160.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1965-g7d63482a-1jammy [33.9 kB] 2024-03-08T21:30:20.297 INFO:teuthology.orchestra.run.smithi160.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1965-g7d63482a-1jammy [23.4 kB] 2024-03-08T21:30:20.297 INFO:teuthology.orchestra.run.smithi160.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1965-g7d63482a-1jammy [38.4 kB] 2024-03-08T21:30:20.298 INFO:teuthology.orchestra.run.smithi160.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1965-g7d63482a-1jammy [13.0 MB] 2024-03-08T21:30:20.578 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-08T21:30:20.593 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:20.636 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:20.761 INFO:teuthology.orchestra.run.smithi160.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/rishabh-2024mar8/7d63482aa89628d733e298984a762389b625c761/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1965-g7d63482a-1jammy [91.5 kB] 2024-03-08T21:30:20.931 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2024-03-08T21:30:20.947 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-08T21:30:20.989 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-08T21:30:21.250 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2024-03-08T21:30:21.265 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:21.309 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:21.395 INFO:teuthology.orchestra.run.smithi160.stdout:Fetched 177 MB in 19s (9,477 kB/s) 2024-03-08T21:30:21.581 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-08T21:30:21.647 INFO:teuthology.orchestra.run.smithi160.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-08T21:30:21.650 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-08T21:30:21.661 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-08T21:30:21.676 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-08T21:30:21.696 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-08T21:30:21.711 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-08T21:30:21.956 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-08T21:30:21.970 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-08T21:30:22.014 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-08T21:30:22.058 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-08T21:30:22.071 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-08T21:30:22.116 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-08T21:30:22.308 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-08T21:30:22.323 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-08T21:30:22.367 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-08T21:30:22.485 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-cmd2. 2024-03-08T21:30:22.500 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-08T21:30:22.552 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-08T21:30:22.679 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua5.1. 2024-03-08T21:30:22.694 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-08T21:30:22.736 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-08T21:30:22.963 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-08T21:30:22.978 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-08T21:30:23.039 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-any. 2024-03-08T21:30:23.054 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-08T21:30:23.080 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-08T21:30:23.089 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-08T21:30:23.342 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package zip. 2024-03-08T21:30:23.357 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-08T21:30:23.400 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking zip (3.0-12build2) ... 2024-03-08T21:30:23.492 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-08T21:30:23.506 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-08T21:30:23.558 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-08T21:30:23.737 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package unzip. 2024-03-08T21:30:23.752 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-08T21:30:23.795 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-08T21:30:23.969 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-08T21:30:23.984 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-08T21:30:24.036 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-08T21:30:24.216 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package luarocks. 2024-03-08T21:30:24.231 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-08T21:30:24.274 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-08T21:30:24.540 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-08T21:30:24.554 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:24.614 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:24.632 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2024-03-08T21:30:24.646 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-librgw2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:24.682 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:24.975 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-08T21:30:24.990 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:25.025 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:25.168 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2024-03-08T21:30:25.182 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:25.259 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:25.345 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-08T21:30:25.360 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-08T21:30:25.403 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:30:25.596 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-08T21:30:25.611 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-08T21:30:25.654 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-08T21:30:25.748 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-08T21:30:25.763 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-08T21:30:25.806 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-08T21:30:25.965 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2024-03-08T21:30:25.980 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:26.023 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:26.126 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package librados2. 2024-03-08T21:30:26.140 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../010-librados2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:26.200 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking librados2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:26.469 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2024-03-08T21:30:26.484 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:26.526 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:26.578 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package librbd1. 2024-03-08T21:30:26.592 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../011-librbd1_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:26.628 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking librbd1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:27.033 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libcephfs2. 2024-03-08T21:30:27.047 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:27.091 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libcephfs2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:27.360 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-rados. 2024-03-08T21:30:27.374 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:27.410 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-rados (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:27.590 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2024-03-08T21:30:27.605 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:27.682 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:27.712 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-08T21:30:27.727 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:27.762 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-ceph-argparse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:27.998 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-cephfs. 2024-03-08T21:30:28.013 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:28.056 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-cephfs (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:28.220 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-08T21:30:28.234 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-08T21:30:28.278 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-08T21:30:28.376 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-08T21:30:28.390 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:28.434 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:28.581 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2024-03-08T21:30:28.596 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-08T21:30:28.639 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-08T21:30:28.770 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-prettytable. 2024-03-08T21:30:28.785 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-08T21:30:28.828 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-08T21:30:29.026 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-08T21:30:29.040 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-08T21:30:29.084 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-08T21:30:29.114 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-rbd. 2024-03-08T21:30:29.128 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:29.172 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-rbd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:29.353 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-08T21:30:29.368 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-08T21:30:29.403 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-08T21:30:29.467 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-08T21:30:29.481 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-08T21:30:29.516 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-08T21:30:29.706 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-08T21:30:29.721 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-08T21:30:29.764 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-08T21:30:29.786 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-08T21:30:29.800 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-08T21:30:29.844 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-08T21:30:30.089 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2024-03-08T21:30:30.104 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-08T21:30:30.130 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-08T21:30:30.145 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-08T21:30:30.150 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-08T21:30:30.188 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-08T21:30:30.454 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2024-03-08T21:30:30.468 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-08T21:30:30.512 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-08T21:30:30.550 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package lua5.1. 2024-03-08T21:30:30.565 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-08T21:30:30.608 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-08T21:30:30.781 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-08T21:30:30.796 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-08T21:30:30.839 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-08T21:30:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package lua-any. 2024-03-08T21:30:30.884 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-08T21:30:30.919 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-08T21:30:31.143 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-08T21:30:31.146 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package zip. 2024-03-08T21:30:31.158 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-08T21:30:31.161 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-08T21:30:31.200 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-08T21:30:31.204 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking zip (3.0-12build2) ... 2024-03-08T21:30:31.508 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package unzip. 2024-03-08T21:30:31.522 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-08T21:30:31.537 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2024-03-08T21:30:31.552 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-08T21:30:31.566 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-08T21:30:31.596 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-08T21:30:31.890 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2024-03-08T21:30:31.905 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-08T21:30:31.948 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-08T21:30:31.978 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package luarocks. 2024-03-08T21:30:31.993 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-08T21:30:32.028 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-08T21:30:32.252 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-08T21:30:32.267 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-08T21:30:32.310 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-08T21:30:32.343 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package librgw2. 2024-03-08T21:30:32.357 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../027-librgw2_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:32.402 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking librgw2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:32.588 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2024-03-08T21:30:32.603 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-08T21:30:32.646 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-08T21:30:32.862 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-rgw. 2024-03-08T21:30:32.876 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:32.921 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-rgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:32.966 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-08T21:30:32.981 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-08T21:30:33.024 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-08T21:30:33.281 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-08T21:30:33.295 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-08T21:30:33.310 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-08T21:30:33.325 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-08T21:30:33.340 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-08T21:30:33.369 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-08T21:30:33.626 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libradosstriper1. 2024-03-08T21:30:33.640 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:33.676 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libradosstriper1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:33.855 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2024-03-08T21:30:33.870 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-08T21:30:33.921 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-08T21:30:34.274 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2024-03-08T21:30:34.289 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-08T21:30:34.335 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-08T21:30:34.423 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-common. 2024-03-08T21:30:34.438 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:34.628 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2024-03-08T21:30:34.643 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-08T21:30:34.685 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-08T21:30:35.088 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:35.647 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2024-03-08T21:30:35.663 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-08T21:30:35.697 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-08T21:30:36.008 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-08T21:30:36.023 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-08T21:30:36.075 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-08T21:30:36.186 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-base. 2024-03-08T21:30:36.199 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:36.251 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-base (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:36.361 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-08T21:30:36.376 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-08T21:30:36.411 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-08T21:30:36.714 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2024-03-08T21:30:36.729 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-08T21:30:36.772 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-08T21:30:36.847 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-08T21:30:36.861 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-08T21:30:36.905 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-08T21:30:37.108 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2024-03-08T21:30:37.124 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-08T21:30:37.166 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-cheroot. 2024-03-08T21:30:37.175 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-08T21:30:37.180 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-08T21:30:37.216 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-08T21:30:37.519 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-08T21:30:37.534 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-08T21:30:37.572 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2024-03-08T21:30:37.577 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-08T21:30:37.587 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-08T21:30:37.621 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-08T21:30:37.880 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-08T21:30:37.894 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-08T21:30:37.924 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2024-03-08T21:30:37.938 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-08T21:30:37.939 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-08T21:30:37.983 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-08T21:30:38.224 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-08T21:30:38.239 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-08T21:30:38.282 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-08T21:30:38.302 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2024-03-08T21:30:38.318 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-08T21:30:38.360 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-08T21:30:38.627 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-tempora. 2024-03-08T21:30:38.641 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-08T21:30:38.702 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-08T21:30:38.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2024-03-08T21:30:38.721 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-08T21:30:38.764 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-08T21:30:39.067 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-08T21:30:39.071 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-portend. 2024-03-08T21:30:39.082 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-08T21:30:39.086 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-08T21:30:39.125 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-08T21:30:39.138 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-08T21:30:39.411 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-08T21:30:39.427 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:39.469 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:39.507 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-08T21:30:39.522 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-08T21:30:39.566 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-08T21:30:39.824 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-08T21:30:39.838 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:39.843 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-08T21:30:39.858 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-08T21:30:39.893 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-08T21:30:39.907 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:40.227 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-08T21:30:40.242 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-08T21:30:40.271 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-natsort. 2024-03-08T21:30:40.285 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-08T21:30:40.286 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-08T21:30:40.329 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-08T21:30:40.588 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2024-03-08T21:30:40.603 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-08T21:30:40.624 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-logutils. 2024-03-08T21:30:40.639 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-08T21:30:40.646 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-08T21:30:40.674 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-08T21:30:40.919 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-08T21:30:40.933 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-08T21:30:40.968 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-08T21:30:40.983 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2024-03-08T21:30:40.998 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:41.041 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:41.271 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-mako. 2024-03-08T21:30:41.286 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-08T21:30:41.329 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-08T21:30:41.428 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2024-03-08T21:30:41.444 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:41.486 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:41.699 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-08T21:30:41.714 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-08T21:30:41.758 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-08T21:30:42.056 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2024-03-08T21:30:42.068 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-08T21:30:42.070 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:42.083 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-08T21:30:42.114 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:42.135 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-08T21:30:42.496 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-webob. 2024-03-08T21:30:42.511 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-08T21:30:42.562 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-08T21:30:42.867 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2024-03-08T21:30:42.882 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-ceph_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:42.926 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:43.007 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-waitress. 2024-03-08T21:30:43.026 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-08T21:30:43.084 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-08T21:30:43.245 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2024-03-08T21:30:43.260 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:43.303 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:43.377 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-tempita. 2024-03-08T21:30:43.390 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-08T21:30:43.434 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-08T21:30:43.681 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2024-03-08T21:30:43.696 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:43.737 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-paste. 2024-03-08T21:30:43.739 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:43.749 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-08T21:30:43.787 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-08T21:30:44.073 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-08T21:30:44.075 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2024-03-08T21:30:44.085 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-08T21:30:44.090 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-cephadm_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:44.157 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-08T21:30:44.159 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:44.460 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-08T21:30:44.470 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-08T21:30:44.471 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-08T21:30:44.485 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-08T21:30:44.510 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-08T21:30:44.528 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-08T21:30:44.796 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-webtest. 2024-03-08T21:30:44.810 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-08T21:30:44.839 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-08T21:30:44.854 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-08T21:30:44.854 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-08T21:30:44.898 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-08T21:30:45.148 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pecan. 2024-03-08T21:30:45.161 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-08T21:30:45.198 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-08T21:30:45.569 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-certifi. 2024-03-08T21:30:45.582 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-08T21:30:45.619 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-08T21:30:45.869 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2024-03-08T21:30:45.883 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-08T21:30:45.927 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-08T21:30:45.947 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-idna. 2024-03-08T21:30:45.961 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-08T21:30:46.006 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-08T21:30:46.264 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2024-03-08T21:30:46.277 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-08T21:30:46.308 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-urllib3. 2024-03-08T21:30:46.321 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-08T21:30:46.322 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-08T21:30:46.366 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-08T21:30:46.675 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-08T21:30:46.686 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-requests. 2024-03-08T21:30:46.688 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:46.699 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-08T21:30:46.733 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:46.744 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-08T21:30:47.070 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-08T21:30:47.080 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-08T21:30:47.083 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-08T21:30:47.093 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-08T21:30:47.128 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-08T21:30:47.138 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-08T21:30:47.431 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2024-03-08T21:30:47.434 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-08T21:30:47.445 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-08T21:30:47.446 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:47.489 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-08T21:30:47.491 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:47.809 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-08T21:30:47.823 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-08T21:30:47.867 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:47.869 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:47.903 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-08T21:30:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-08T21:30:48.273 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-08T21:30:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-08T21:30:48.301 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-08T21:30:48.345 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-08T21:30:48.585 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-openssl. 2024-03-08T21:30:48.598 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-08T21:30:48.642 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-08T21:30:48.816 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2024-03-08T21:30:48.830 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-08T21:30:48.865 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-08T21:30:48.987 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr. 2024-03-08T21:30:49.001 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:49.045 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:49.406 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mon. 2024-03-08T21:30:49.419 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-08T21:30:49.420 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:49.430 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-08T21:30:49.456 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mon (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:49.546 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-08T21:30:49.857 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2024-03-08T21:30:49.868 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-08T21:30:49.907 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-08T21:30:50.052 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-osd. 2024-03-08T21:30:50.065 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:50.110 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-osd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:50.533 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-08T21:30:50.546 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:50.583 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:50.904 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph. 2024-03-08T21:30:50.918 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../068-ceph_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:50.962 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:51.265 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-fuse. 2024-03-08T21:30:51.279 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:51.323 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:51.528 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2024-03-08T21:30:51.541 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-08T21:30:51.578 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-08T21:30:51.626 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mds. 2024-03-08T21:30:51.640 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:51.685 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mds (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:51.880 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-08T21:30:51.893 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-08T21:30:51.931 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-08T21:30:52.054 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package cephadm. 2024-03-08T21:30:52.068 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../071-cephadm_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:52.113 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:52.250 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-08T21:30:52.263 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-08T21:30:52.342 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-08T21:30:52.448 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-08T21:30:52.462 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-08T21:30:52.506 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-08T21:30:52.653 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2024-03-08T21:30:52.666 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-08T21:30:52.703 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-08T21:30:52.834 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-08T21:30:52.848 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-08T21:30:52.892 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-08T21:30:53.007 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2024-03-08T21:30:53.020 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-08T21:30:53.057 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-08T21:30:53.344 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-08T21:30:53.356 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-08T21:30:53.394 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-08T21:30:53.738 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2024-03-08T21:30:53.751 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-08T21:30:53.788 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-08T21:30:53.904 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-babel. 2024-03-08T21:30:53.911 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-08T21:30:53.954 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-08T21:30:54.141 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-08T21:30:54.154 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-08T21:30:54.191 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-08T21:30:54.266 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-jinja2. 2024-03-08T21:30:54.272 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-08T21:30:54.315 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-08T21:30:54.669 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-08T21:30:54.675 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:54.710 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:54.915 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-08T21:30:54.927 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:54.965 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:55.080 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-08T21:30:55.088 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-08T21:30:55.130 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-08T21:30:55.284 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-08T21:30:55.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-08T21:30:55.334 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-08T21:30:55.499 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-routes. 2024-03-08T21:30:55.507 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-08T21:30:55.540 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-08T21:30:55.796 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-08T21:30:55.807 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-08T21:30:55.827 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-08T21:30:55.835 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:55.846 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-08T21:30:55.869 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:56.098 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2024-03-08T21:30:56.110 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-08T21:30:56.140 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-08T21:30:56.297 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-08T21:30:56.304 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-08T21:30:56.368 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2024-03-08T21:30:56.380 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-08T21:30:56.388 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-08T21:30:56.418 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-08T21:30:56.705 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2024-03-08T21:30:56.717 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-08T21:30:56.754 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-08T21:30:56.883 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-joblib. 2024-03-08T21:30:56.890 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-08T21:30:56.925 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-08T21:30:57.092 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2024-03-08T21:30:57.103 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:57.141 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:57.269 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-08T21:30:57.279 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-08T21:30:57.413 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-08T21:30:57.693 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-sklearn. 2024-03-08T21:30:57.704 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-08T21:30:57.782 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-08T21:30:58.441 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-08T21:30:58.451 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:58.491 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:59.096 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2024-03-08T21:30:59.109 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:30:59.146 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:59.478 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-cachetools. 2024-03-08T21:30:59.488 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-08T21:30:59.530 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-08T21:30:59.534 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-08T21:30:59.543 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:30:59.583 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:30:59.789 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-08T21:30:59.802 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-08T21:30:59.838 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-08T21:30:59.844 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2024-03-08T21:30:59.856 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-08T21:30:59.886 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-08T21:31:00.091 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-08T21:31:00.102 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-08T21:31:00.143 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-08T21:31:00.197 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2024-03-08T21:31:00.209 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:00.247 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:00.469 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-rsa. 2024-03-08T21:31:00.481 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-08T21:31:00.491 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2024-03-08T21:31:00.501 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:00.519 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-08T21:31:00.541 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:00.777 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-08T21:31:00.787 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:00.827 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:00.848 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-google-auth. 2024-03-08T21:31:00.860 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-08T21:31:00.897 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-08T21:31:01.146 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-08T21:31:01.157 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-08T21:31:01.184 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-08T21:31:01.196 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-08T21:31:01.196 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-08T21:31:01.225 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-08T21:31:01.512 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-websocket. 2024-03-08T21:31:01.524 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-08T21:31:01.542 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-08T21:31:01.554 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-08T21:31:01.561 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-08T21:31:01.592 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-08T21:31:01.890 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-08T21:31:01.901 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-08T21:31:01.938 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2024-03-08T21:31:01.949 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-08T21:31:01.973 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-08T21:31:01.988 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-08T21:31:02.418 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pkg-config. 2024-03-08T21:31:02.429 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-08T21:31:02.484 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-08T21:31:02.647 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-08T21:31:02.658 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:02.696 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:02.721 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-08T21:31:02.731 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-08T21:31:02.770 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-08T21:31:03.016 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-08T21:31:03.027 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-08T21:31:03.066 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-08T21:31:03.165 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-08T21:31:03.176 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-08T21:31:03.215 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-08T21:31:03.419 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-08T21:31:03.430 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-08T21:31:03.477 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-08T21:31:03.517 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2024-03-08T21:31:03.534 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-08T21:31:03.576 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-08T21:31:03.746 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package jq. 2024-03-08T21:31:03.758 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-08T21:31:03.796 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-08T21:31:03.929 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2024-03-08T21:31:03.942 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-08T21:31:03.979 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-08T21:31:04.049 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package socat. 2024-03-08T21:31:04.061 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-08T21:31:04.098 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-08T21:31:04.274 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2024-03-08T21:31:04.286 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-08T21:31:04.324 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-08T21:31:04.402 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package xmlstarlet. 2024-03-08T21:31:04.413 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-08T21:31:04.451 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-08T21:31:04.660 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2024-03-08T21:31:04.673 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-08T21:31:04.709 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-08T21:31:04.839 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-test. 2024-03-08T21:31:04.850 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:04.889 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-test (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:05.047 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2024-03-08T21:31:05.060 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-08T21:31:05.096 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-08T21:31:05.559 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-08T21:31:05.571 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-08T21:31:05.608 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-08T21:31:05.895 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2024-03-08T21:31:05.907 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-08T21:31:05.936 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-08T21:31:06.256 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2024-03-08T21:31:06.269 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-08T21:31:06.314 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-08T21:31:06.593 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2024-03-08T21:31:06.605 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-08T21:31:06.634 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-08T21:31:06.920 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-08T21:31:06.932 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-08T21:31:06.970 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-08T21:31:07.060 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ceph-volume. 2024-03-08T21:31:07.071 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:07.109 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ceph-volume (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:07.480 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-08T21:31:07.492 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:07.549 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking cephfs-mirror (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:07.732 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2024-03-08T21:31:07.744 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../122-radosgw_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:07.782 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:07.816 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-colorama. 2024-03-08T21:31:07.828 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-08T21:31:07.857 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-08T21:31:08.110 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package cephfs-shell. 2024-03-08T21:31:08.122 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:08.160 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking cephfs-shell (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:08.377 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2024-03-08T21:31:08.389 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:08.426 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:08.446 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package cephfs-top. 2024-03-08T21:31:08.458 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1965-g7d63482a-1jammy_all.deb ... 2024-03-08T21:31:08.496 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking cephfs-top (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:08.749 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-08T21:31:08.753 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-08T21:31:08.760 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:08.798 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libcephfs-dev (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:09.007 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-08T21:31:09.093 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-08T21:31:09.105 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-08T21:31:09.133 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-08T21:31:09.134 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-08T21:31:09.388 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-08T21:31:09.464 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-08T21:31:09.476 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-08T21:31:09.514 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-08T21:31:09.786 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-08T21:31:09.893 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package nvme-cli. 2024-03-08T21:31:09.904 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-08T21:31:09.942 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-08T21:31:10.390 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package pkg-config. 2024-03-08T21:31:10.398 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-08T21:31:10.400 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-08T21:31:10.439 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-08T21:31:10.445 INFO:teuthology.orchestra.run.smithi119.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-08T21:31:10.493 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:10.700 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-08T21:31:10.712 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-08T21:31:10.750 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-08T21:31:11.033 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2024-03-08T21:31:11.186 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-08T21:31:11.190 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-08T21:31:11.198 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-08T21:31:11.236 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-08T21:31:11.475 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-08T21:31:11.539 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pastescript. 2024-03-08T21:31:11.551 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-08T21:31:11.589 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-08T21:31:11.760 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-08T21:31:11.886 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-08T21:31:11.933 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pluggy. 2024-03-08T21:31:11.945 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-08T21:31:11.983 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-08T21:31:12.145 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-08T21:31:12.278 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-psutil. 2024-03-08T21:31:12.290 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-08T21:31:12.319 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-08T21:31:12.421 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-08T21:31:12.539 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-08T21:31:12.650 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-py. 2024-03-08T21:31:12.658 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-08T21:31:12.705 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-08T21:31:12.849 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-08T21:31:13.053 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pygments. 2024-03-08T21:31:13.065 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-08T21:31:13.108 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-08T21:31:13.218 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-08T21:31:13.486 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-08T21:31:13.571 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-08T21:31:13.582 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-08T21:31:13.620 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-08T21:31:13.762 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-08T21:31:13.932 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-toml. 2024-03-08T21:31:13.943 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-08T21:31:13.981 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-08T21:31:14.022 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-08T21:31:14.284 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-pytest. 2024-03-08T21:31:14.296 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-08T21:31:14.298 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-08T21:31:14.334 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-08T21:31:14.558 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-08T21:31:14.671 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package python3-simplejson. 2024-03-08T21:31:14.682 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-08T21:31:14.712 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-08T21:31:14.940 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-08T21:31:14.951 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-08T21:31:14.959 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-08T21:31:14.981 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-08T21:31:15.226 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:15.494 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-08T21:31:15.629 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-08T21:31:15.718 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package radosgw. 2024-03-08T21:31:15.729 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../122-radosgw_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:15.763 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-08T21:31:15.801 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking radosgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:16.031 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-08T21:31:16.157 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-08T21:31:16.405 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package rbd-fuse. 2024-03-08T21:31:16.416 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-08T21:31:16.417 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1965-g7d63482a-1jammy_amd64.deb ... 2024-03-08T21:31:16.454 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking rbd-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:16.762 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-08T21:31:16.922 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-08T21:31:16.955 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-08T21:31:17.009 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-08T21:31:17.019 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-08T21:31:17.119 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-08T21:31:17.179 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-08T21:31:17.397 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-08T21:31:17.547 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-08T21:31:17.673 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-08T21:31:17.800 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-08T21:31:17.940 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-08T21:31:18.217 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-08T21:31:18.416 INFO:teuthology.orchestra.run.smithi160.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-08T21:31:18.488 INFO:teuthology.orchestra.run.smithi160.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-08T21:31:18.534 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up zip (3.0-12build2) ... 2024-03-08T21:31:18.579 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:18.660 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-08T21:31:19.097 INFO:teuthology.orchestra.run.smithi160.stdout:Adding system user cephadm....done 2024-03-08T21:31:19.251 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-08T21:31:19.346 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-08T21:31:19.527 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-08T21:31:19.588 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-08T21:31:19.689 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-08T21:31:19.778 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-08T21:31:19.816 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-08T21:31:19.929 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-08T21:31:20.133 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-08T21:31:20.189 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-08T21:31:20.456 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-08T21:31:20.535 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-08T21:31:20.582 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-08T21:31:20.892 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-08T21:31:21.127 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-08T21:31:21.303 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-08T21:31:21.504 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-08T21:31:21.554 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-08T21:31:21.805 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-08T21:31:21.822 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-08T21:31:22.107 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-08T21:31:22.123 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-08T21:31:22.324 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-08T21:31:22.491 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-08T21:31:22.584 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-08T21:31:22.759 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-08T21:31:22.876 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-08T21:31:22.885 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:23.128 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-ceph-argparse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:23.186 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1) ... 2024-03-08T21:31:23.395 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-08T21:31:23.521 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-08T21:31:23.521 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-08T21:31:23.647 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-08T21:31:23.906 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-08T21:31:24.057 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-08T21:31:24.308 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-08T21:31:24.704 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-08T21:31:24.731 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-08T21:31:24.743 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-08T21:31:24.778 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-08T21:31:24.896 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-08T21:31:24.970 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:25.088 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-08T21:31:25.264 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-08T21:31:25.356 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-08T21:31:25.431 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-08T21:31:25.473 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-08T21:31:25.599 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-08T21:31:25.841 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-08T21:31:25.900 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-08T21:31:26.108 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-08T21:31:26.168 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-08T21:31:26.418 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up zip (3.0-12build2) ... 2024-03-08T21:31:26.444 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:26.527 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-08T21:31:26.570 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-08T21:31:26.880 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-08T21:31:27.131 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-08T21:31:27.196 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-08T21:31:27.399 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-08T21:31:27.472 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-08T21:31:27.589 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-08T21:31:27.667 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-08T21:31:27.690 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-08T21:31:27.926 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-08T21:31:27.992 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-08T21:31:28.202 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-08T21:31:28.353 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-08T21:31:28.418 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-08T21:31:28.621 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-08T21:31:28.669 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-08T21:31:28.722 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-08T21:31:29.015 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-08T21:31:29.045 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-08T21:31:29.324 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-08T21:31:29.346 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-08T21:31:29.592 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-08T21:31:29.706 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-08T21:31:29.718 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-08T21:31:29.844 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-08T21:31:29.924 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-08T21:31:30.066 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-08T21:31:30.179 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-08T21:31:30.305 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-08T21:31:30.316 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-08T21:31:30.442 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:30.715 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-08T21:31:30.744 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-idna (3.3-1) ... 2024-03-08T21:31:30.991 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-08T21:31:31.112 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-08T21:31:31.117 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-08T21:31:31.385 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:31.511 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-08T21:31:31.829 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-08T21:31:32.172 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-08T21:31:32.325 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-08T21:31:32.431 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-08T21:31:32.577 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:32.642 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-08T21:31:32.712 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-08T21:31:32.919 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-08T21:31:32.979 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-08T21:31:33.105 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-08T21:31:33.187 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-08T21:31:33.231 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-08T21:31:33.446 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-08T21:31:33.569 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-08T21:31:33.807 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-08T21:31:33.825 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-08T21:31:34.084 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:34.100 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-08T21:31:34.210 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-08T21:31:34.461 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-08T21:31:34.512 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-08T21:31:34.586 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:34.713 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:34.780 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-08T21:31:34.814 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-08T21:31:35.047 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-08T21:31:35.150 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:35.276 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:35.298 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-08T21:31:35.402 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-08T21:31:35.557 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-08T21:31:35.696 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:35.813 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-08T21:31:35.914 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-08T21:31:36.121 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-08T21:31:36.122 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-08T21:31:36.219 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-08T21:31:36.378 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-08T21:31:36.671 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-08T21:31:36.807 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:36.933 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:36.981 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-08T21:31:37.059 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:37.185 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:37.232 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-08T21:31:37.311 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-08T21:31:37.357 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-08T21:31:37.483 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-08T21:31:37.572 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-08T21:31:37.818 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-08T21:31:37.944 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-08T21:31:38.337 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-08T21:31:38.590 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:38.613 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-08T21:31:38.716 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:38.731 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-08T21:31:38.842 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:38.968 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:38.982 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-08T21:31:39.094 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:39.133 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-08T21:31:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:39.459 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-08T21:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-08T21:31:39.798 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2024-03-08T21:31:40.028 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-08T21:31:40.165 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2024-03-08T21:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-08T21:31:40.334 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2024-03-08T21:31:40.356 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-08T21:31:40.498 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-08T21:31:40.507 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-08T21:31:40.767 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-08T21:31:40.907 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-08T21:31:41.035 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-08T21:31:41.420 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-08T21:31:41.596 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:41.737 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-08T21:31:41.829 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-08T21:31:41.829 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-08T21:31:42.107 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-08T21:31:42.208 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up librados2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:42.325 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:42.430 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:42.451 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-08T21:31:42.557 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:42.788 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libcephfs2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:42.914 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libradosstriper1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:43.031 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-08T21:31:43.068 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-08T21:31:43.068 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-08T21:31:43.349 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up librbd1 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr-modules-core (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:43.585 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:43.691 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:43.785 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-08T21:31:43.785 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-08T21:31:44.053 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-08T21:31:44.511 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libcephfs-dev (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:44.637 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-rados (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:44.701 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:44.738 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up librgw2 (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:44.839 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up cephfs-top (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:44.924 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-08T21:31:44.924 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-08T21:31:44.948 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-08T21:31:45.606 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:45.821 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-08T21:31:45.821 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-08T21:31:46.219 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-rbd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.344 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up rbd-fuse (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.462 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-rgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.507 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.588 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up python3-cephfs (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.714 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up cephfs-shell (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-common (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:47.039 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-08T21:31:47.039 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-08T21:31:47.426 INFO:teuthology.orchestra.run.smithi160.stdout:Adding group ceph....done 2024-03-08T21:31:47.686 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:47.760 INFO:teuthology.orchestra.run.smithi160.stdout:Adding system user ceph....done 2024-03-08T21:31:47.837 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:47.904 INFO:teuthology.orchestra.run.smithi160.stdout:Setting system user ceph properties....done 2024-03-08T21:31:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-08T21:31:47.971 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:48.060 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-08T21:31:48.163 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-08T21:31:48.163 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-08T21:31:48.458 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-08T21:31:48.790 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:48.966 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:49.092 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:49.207 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up cephfs-mirror (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:49.234 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:49.454 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-08T21:31:49.455 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-08T21:31:49.595 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-08T21:31:49.704 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-08T21:31:49.856 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-08T21:31:50.143 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-test (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:50.268 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up radosgw (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:50.615 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-08T21:31:50.807 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-08T21:31:50.807 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-08T21:31:51.291 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-08T21:31:51.296 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-08T21:31:51.369 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-03-08T21:31:51.538 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-03-08T21:31:51.539 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-03-08T21:31:51.698 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-08T21:31:51.699 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-08T21:31:51.699 INFO:teuthology.orchestra.run.smithi119.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-08T21:31:51.699 INFO:teuthology.orchestra.run.smithi119.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-08T21:31:51.699 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-08T21:31:51.699 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-08T21:31:51.700 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-08T21:31:51.702 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-03-08T21:31:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-08T21:31:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-08T21:31:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-08T21:31:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-08T21:31:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-08T21:31:51.703 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-03-08T21:31:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-08T21:31:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-08T21:31:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: libengine-pkcs11-openssl 2024-03-08T21:31:51.752 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-08T21:31:51.753 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-08T21:31:51.754 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-03-08T21:31:51.754 INFO:teuthology.orchestra.run.smithi119.stdout: libssl3 2024-03-08T21:31:51.937 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-base (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:51.939 INFO:teuthology.orchestra.run.smithi119.stdout:1 upgraded, 39 newly installed, 0 to remove and 277 not upgraded. 2024-03-08T21:31:51.939 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 54.6 MB of archives. 2024-03-08T21:31:51.939 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-08T21:31:51.939 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-08T21:31:52.300 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-08T21:31:52.436 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-08T21:31:52.694 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-08T21:31:52.730 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-08T21:31:52.731 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-08T21:31:52.736 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-08T21:31:52.739 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-08T21:31:52.740 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-08T21:31:52.742 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-08T21:31:52.745 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-08T21:31:52.745 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-08T21:31:52.910 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-08T21:31:52.988 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mds (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:53.211 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-08T21:31:53.211 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-08T21:31:53.246 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-08T21:31:53.840 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:54.051 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-08T21:31:54.051 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-08T21:31:54.320 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-08T21:31:54.321 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-08T21:31:54.322 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-08T21:31:54.324 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-08T21:31:54.324 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-08T21:31:54.342 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-08T21:31:54.343 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-08T21:31:54.350 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-08T21:31:54.351 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-08T21:31:54.591 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-08T21:31:54.673 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-08T21:31:54.749 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-osd (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:55.107 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-08T21:31:55.107 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-08T21:31:55.154 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-08T21:31:55.288 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-08T21:31:55.301 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-08T21:31:55.301 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-08T21:31:55.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-08T21:31:55.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-08T21:31:55.336 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-08T21:31:55.340 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-08T21:31:55.770 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:55.778 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-08T21:31:55.943 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-08T21:31:55.989 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:56.025 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-08T21:31:56.025 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-08T21:31:56.111 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-08T21:31:56.119 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-08T21:31:56.199 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mon (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:56.468 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-08T21:31:56.468 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-08T21:31:56.584 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-08T21:31:56.586 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-08T21:31:56.971 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2024-03-08T21:31:57.089 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr-cephadm (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:57.121 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-03-08T21:31:57.215 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package flex. 2024-03-08T21:31:57.231 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:57.282 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-08T21:31:57.286 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-08T21:31:57.330 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-08T21:31:57.357 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-mgr-dashboard (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:57.500 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ceph-volume (19.0.0-1965-g7d63482a-1jammy) ... 2024-03-08T21:31:57.836 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-08T21:31:57.908 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-08T21:31:57.928 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-08T21:31:58.080 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-08T21:31:58.086 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-08T21:31:58.500 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:31:59.022 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-08T21:31:59.028 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package bison. 2024-03-08T21:31:59.098 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-08T21:31:59.101 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-08T21:31:59.148 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-08T21:31:59.548 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-08T21:31:59.562 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-08T21:31:59.598 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-08T21:31:59.704 INFO:teuthology.orchestra.run.smithi160.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-08T21:31:59.709 DEBUG:teuthology.orchestra.run.smithi160:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-08T21:31:59.782 INFO:teuthology.orchestra.run.smithi160.stdout:Reading package lists... 2024-03-08T21:31:59.952 INFO:teuthology.orchestra.run.smithi160.stdout:Building dependency tree... 2024-03-08T21:31:59.952 INFO:teuthology.orchestra.run.smithi160.stdout:Reading state information... 2024-03-08T21:31:59.960 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2024-03-08T21:31:59.974 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-08T21:32:00.018 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b47-3) ... 2024-03-08T21:32:00.112 INFO:teuthology.orchestra.run.smithi160.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-08T21:32:00.112 INFO:teuthology.orchestra.run.smithi160.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-08T21:32:00.112 INFO:teuthology.orchestra.run.smithi160.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-03-08T21:32:00.112 INFO:teuthology.orchestra.run.smithi160.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-03-08T21:32:00.112 INFO:teuthology.orchestra.run.smithi160.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-08T21:32:00.113 INFO:teuthology.orchestra.run.smithi160.stdout:The following packages were automatically installed and are no longer required: 2024-03-08T21:32:00.113 INFO:teuthology.orchestra.run.smithi160.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-08T21:32:00.113 INFO:teuthology.orchestra.run.smithi160.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-08T21:32:00.113 INFO:teuthology.orchestra.run.smithi160.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-08T21:32:00.113 INFO:teuthology.orchestra.run.smithi160.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout:The following additional packages will be installed: 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-08T21:32:00.114 INFO:teuthology.orchestra.run.smithi160.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-08T21:32:00.115 INFO:teuthology.orchestra.run.smithi160.stdout:Suggested packages: 2024-03-08T21:32:00.115 INFO:teuthology.orchestra.run.smithi160.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-08T21:32:00.115 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-03-08T21:32:00.115 INFO:teuthology.orchestra.run.smithi160.stdout: libengine-pkcs11-openssl 2024-03-08T21:32:00.165 INFO:teuthology.orchestra.run.smithi160.stdout:The following NEW packages will be installed: 2024-03-08T21:32:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-08T21:32:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-08T21:32:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-08T21:32:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-08T21:32:00.166 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-08T21:32:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-08T21:32:00.167 INFO:teuthology.orchestra.run.smithi160.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-08T21:32:00.167 INFO:teuthology.orchestra.run.smithi160.stdout:The following packages will be upgraded: 2024-03-08T21:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: libssl3 2024-03-08T21:32:00.304 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2024-03-08T21:32:00.319 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:00.351 INFO:teuthology.orchestra.run.smithi160.stdout:1 upgraded, 39 newly installed, 0 to remove and 277 not upgraded. 2024-03-08T21:32:00.352 INFO:teuthology.orchestra.run.smithi160.stdout:Need to get 54.6 MB of archives. 2024-03-08T21:32:00.352 INFO:teuthology.orchestra.run.smithi160.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-08T21:32:00.352 INFO:teuthology.orchestra.run.smithi160.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-08T21:32:00.363 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-08T21:32:00.599 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-08T21:32:00.613 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-08T21:32:00.657 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-08T21:32:00.849 INFO:teuthology.orchestra.run.smithi160.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-08T21:32:00.986 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-08T21:32:01.001 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-08T21:32:01.044 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-08T21:32:01.108 INFO:teuthology.orchestra.run.smithi160.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-08T21:32:01.142 INFO:teuthology.orchestra.run.smithi160.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-08T21:32:01.144 INFO:teuthology.orchestra.run.smithi160.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-08T21:32:01.149 INFO:teuthology.orchestra.run.smithi160.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-08T21:32:01.153 INFO:teuthology.orchestra.run.smithi160.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-08T21:32:01.153 INFO:teuthology.orchestra.run.smithi160.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-08T21:32:01.156 INFO:teuthology.orchestra.run.smithi160.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-08T21:32:01.159 INFO:teuthology.orchestra.run.smithi160.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-08T21:32:01.325 INFO:teuthology.orchestra.run.smithi160.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-08T21:32:01.325 INFO:teuthology.orchestra.run.smithi160.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-08T21:32:01.330 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-08T21:32:01.345 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-08T21:32:01.388 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-08T21:32:01.589 INFO:teuthology.orchestra.run.smithi160.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-08T21:32:01.700 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-08T21:32:01.715 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-08T21:32:01.758 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:02.053 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-08T21:32:02.068 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-08T21:32:02.111 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:02.363 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjson-perl. 2024-03-08T21:32:02.379 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-08T21:32:02.422 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-08T21:32:02.598 INFO:teuthology.orchestra.run.smithi160.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-08T21:32:02.600 INFO:teuthology.orchestra.run.smithi160.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-08T21:32:02.601 INFO:teuthology.orchestra.run.smithi160.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-08T21:32:02.630 INFO:teuthology.orchestra.run.smithi160.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-08T21:32:02.630 INFO:teuthology.orchestra.run.smithi160.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-08T21:32:02.634 INFO:teuthology.orchestra.run.smithi160.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-08T21:32:02.636 INFO:teuthology.orchestra.run.smithi160.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-08T21:32:02.643 INFO:teuthology.orchestra.run.smithi160.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-08T21:32:02.725 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-08T21:32:02.740 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-08T21:32:02.775 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-08T21:32:02.808 INFO:teuthology.orchestra.run.smithi160.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-08T21:32:03.547 INFO:teuthology.orchestra.run.smithi160.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-08T21:32:03.548 INFO:teuthology.orchestra.run.smithi160.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-08T21:32:03.574 INFO:teuthology.orchestra.run.smithi160.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-08T21:32:03.652 INFO:teuthology.orchestra.run.smithi160.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-08T21:32:03.660 INFO:teuthology.orchestra.run.smithi160.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-08T21:32:03.661 INFO:teuthology.orchestra.run.smithi160.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-08T21:32:03.662 INFO:teuthology.orchestra.run.smithi160.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-08T21:32:03.662 INFO:teuthology.orchestra.run.smithi160.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-08T21:32:03.691 INFO:teuthology.orchestra.run.smithi160.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-08T21:32:03.694 INFO:teuthology.orchestra.run.smithi160.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-08T21:32:04.136 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-08T21:32:04.151 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-08T21:32:04.194 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:04.319 INFO:teuthology.orchestra.run.smithi160.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-08T21:32:04.403 INFO:teuthology.orchestra.run.smithi160.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-08T21:32:04.403 INFO:teuthology.orchestra.run.smithi160.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-08T21:32:04.403 INFO:teuthology.orchestra.run.smithi160.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-08T21:32:04.455 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-08T21:32:04.470 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-08T21:32:04.493 INFO:teuthology.orchestra.run.smithi160.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-08T21:32:04.498 INFO:teuthology.orchestra.run.smithi160.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-08T21:32:04.522 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:04.841 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-08T21:32:04.857 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-08T21:32:04.891 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:04.961 INFO:teuthology.orchestra.run.smithi160.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-08T21:32:04.962 INFO:teuthology.orchestra.run.smithi160.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-08T21:32:05.252 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-08T21:32:05.268 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-08T21:32:05.319 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-08T21:32:05.349 INFO:teuthology.orchestra.run.smithi160.stdout:Preconfiguring packages ... 2024-03-08T21:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2024-03-08T21:32:05.630 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-08T21:32:05.636 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package flex. 2024-03-08T21:32:05.646 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-08T21:32:05.688 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-08T21:32:05.709 INFO:teuthology.orchestra.run.smithi160.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140586 files and directories currently installed.) 2024-03-08T21:32:05.712 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-08T21:32:05.752 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-08T21:32:06.041 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-08T21:32:06.057 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:06.102 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:06.444 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-08T21:32:06.447 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-08T21:32:06.460 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:06.511 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:06.649 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-08T21:32:06.797 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-08T21:32:06.812 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:06.855 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:07.115 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:32:07.159 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-08T21:32:07.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-08T21:32:07.217 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:32:07.709 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package bison. 2024-03-08T21:32:07.720 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-08T21:32:07.736 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-08T21:32:07.779 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-08T21:32:07.779 INFO:teuthology.orchestra.run.smithi160.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140659 files and directories currently installed.) 2024-03-08T21:32:07.783 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-08T21:32:07.836 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-08T21:32:08.140 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2024-03-08T21:32:08.156 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-08T21:32:08.198 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:08.220 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-08T21:32:08.234 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-08T21:32:08.287 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-08T21:32:08.623 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package dump. 2024-03-08T21:32:08.637 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-08T21:32:08.681 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking dump (0.4b47-3) ... 2024-03-08T21:32:08.872 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2024-03-08T21:32:08.887 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-08T21:32:08.939 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-08T21:32:08.951 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package indent. 2024-03-08T21:32:08.965 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:09.001 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-08T21:32:09.278 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-08T21:32:09.293 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-08T21:32:09.345 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-08T21:32:09.537 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2024-03-08T21:32:09.553 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-08T21:32:09.674 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-08T21:32:09.689 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-08T21:32:09.732 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-08T21:32:09.917 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-08T21:32:10.001 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-08T21:32:10.017 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-08T21:32:10.051 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-08T21:32:10.225 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2024-03-08T21:32:10.239 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-08T21:32:10.284 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-08T21:32:10.363 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-08T21:32:10.379 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-08T21:32:10.421 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:10.536 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-08T21:32:10.551 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-08T21:32:10.595 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-08T21:32:10.740 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-08T21:32:10.756 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-08T21:32:10.798 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:10.898 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-08T21:32:10.912 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-08T21:32:10.956 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-common (238) ... 2024-03-08T21:32:11.051 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libjson-perl. 2024-03-08T21:32:11.066 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-08T21:32:11.109 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-08T21:32:11.285 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-08T21:32:11.301 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:11.344 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-08T21:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-08T21:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-08T21:32:11.965 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-common. 2024-03-08T21:32:11.981 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-08T21:32:12.034 INFO:teuthology.orchestra.run.smithi119.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-08T21:32:12.064 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-common (238) ... 2024-03-08T21:32:12.774 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-14. 2024-03-08T21:32:12.790 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:12.806 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-08T21:32:12.822 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-08T21:32:12.835 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:12.864 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:13.125 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-08T21:32:13.141 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-08T21:32:13.183 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:13.544 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-08T21:32:13.561 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-08T21:32:13.602 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:13.905 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-08T21:32:13.921 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-08T21:32:13.955 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-08T21:32:13.985 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql. 2024-03-08T21:32:14.000 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-08T21:32:14.044 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql (14+238) ... 2024-03-08T21:32:14.275 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-08T21:32:14.287 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client. 2024-03-08T21:32:14.290 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-08T21:32:14.302 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-08T21:32:14.333 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-08T21:32:14.345 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client (14+238) ... 2024-03-08T21:32:14.598 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-08T21:32:14.612 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-08T21:32:14.648 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-08T21:32:14.752 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-08T21:32:14.768 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:14.810 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:14.967 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl8.6. 2024-03-08T21:32:14.982 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-08T21:32:15.025 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-08T21:32:15.147 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-08T21:32:15.162 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:15.197 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:15.312 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl. 2024-03-08T21:32:15.326 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-08T21:32:15.374 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-08T21:32:15.474 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-08T21:32:15.488 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:15.532 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:15.740 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2024-03-08T21:32:15.755 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-08T21:32:15.798 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-08T21:32:15.818 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-08T21:32:15.832 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-08T21:32:15.884 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:32:16.152 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-08T21:32:16.168 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-08T21:32:16.210 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-08T21:32:16.396 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-08T21:32:16.410 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-08T21:32:16.446 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-08T21:32:16.572 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-08T21:32:16.588 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-08T21:32:16.638 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-08T21:32:16.766 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package modemmanager. 2024-03-08T21:32:16.780 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-08T21:32:16.824 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:16.924 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-common (238) ... 2024-03-08T21:32:17.136 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-08T21:32:17.287 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-08T21:32:17.405 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:17.530 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package network-manager. 2024-03-08T21:32:17.531 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-08T21:32:17.545 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-08T21:32:17.587 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-08T21:32:17.657 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-08T21:32:17.783 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:18.137 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package ppp. 2024-03-08T21:32:18.152 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-08T21:32:18.490 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-08T21:32:18.730 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-08T21:32:18.791 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package pptp-linux. 2024-03-08T21:32:18.805 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-08T21:32:18.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-08T21:32:18.841 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-08T21:32:19.068 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-08T21:32:19.083 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-08T21:32:19.126 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-08T21:32:19.215 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-08T21:32:19.215 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-08T21:32:19.438 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-08T21:32:19.452 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-08T21:32:19.496 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-client-common (238) ... 2024-03-08T21:32:19.834 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-08T21:32:19.847 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:19.891 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-08T21:32:20.076 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:32:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-08T21:32:20.328 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-08T21:32:20.446 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:20.479 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-common. 2024-03-08T21:32:20.493 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-08T21:32:20.547 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-08T21:32:20.563 INFO:teuthology.orchestra.run.smithi160.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-08T21:32:20.611 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-common (238) ... 2024-03-08T21:32:20.673 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-08T21:32:21.028 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-14. 2024-03-08T21:32:21.042 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-08T21:32:21.080 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:21.437 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-08T21:32:21.555 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b47-3) ... 2024-03-08T21:32:21.633 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-08T21:32:21.698 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:21.824 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-08T21:32:21.950 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-08T21:32:22.110 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-08T21:32:22.181 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql. 2024-03-08T21:32:22.195 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-08T21:32:22.236 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-08T21:32:22.239 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql (14+238) ... 2024-03-08T21:32:22.325 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-08T21:32:22.396 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-08T21:32:22.482 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-client. 2024-03-08T21:32:22.497 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-08T21:32:22.541 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-client (14+238) ... 2024-03-08T21:32:22.872 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-08T21:32:22.926 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-08T21:32:22.941 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-08T21:32:22.984 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-08T21:32:23.040 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-08T21:32:23.141 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:23.268 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-08T21:32:23.278 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package tcl8.6. 2024-03-08T21:32:23.294 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-08T21:32:23.328 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-08T21:32:23.469 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client (14+238) ... 2024-03-08T21:32:23.595 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-08T21:32:23.598 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package tcl. 2024-03-08T21:32:23.613 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-08T21:32:23.660 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-08T21:32:24.009 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package wpasupplicant. 2024-03-08T21:32:24.025 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-08T21:32:24.067 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2024-03-08T21:32:24.205 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:24.337 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-08T21:32:24.413 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-08T21:32:24.429 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-08T21:32:24.462 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-08T21:32:24.748 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-08T21:32:24.841 INFO:teuthology.orchestra.run.smithi160.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-08T21:32:24.857 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-08T21:32:24.907 INFO:teuthology.orchestra.run.smithi160.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-08T21:32:25.169 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-08T21:32:25.183 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-client-common (238) ... 2024-03-08T21:32:25.388 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-08T21:32:25.539 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-08T21:32:25.640 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:25.758 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-08T21:32:25.883 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-08T21:32:25.889 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:26.010 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:26.033 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:26.158 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-08T21:32:26.285 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-common (238) ... 2024-03-08T21:32:26.944 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-08T21:32:27.049 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-08T21:32:27.256 INFO:teuthology.orchestra.run.smithi119.stdout:Adding user postgres to group ssl-cert 2024-03-08T21:32:27.418 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-08T21:32:27.418 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-08T21:32:27.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:27.507 INFO:teuthology.orchestra.run.smithi119.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-08T21:32:27.773 INFO:teuthology.orchestra.run.smithi119.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-08T21:32:27.774 INFO:teuthology.orchestra.run.smithi119.stdout:Removing obsolete dictionary files: 2024-03-08T21:32:28.126 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-08T21:32:28.260 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-08T21:32:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-08T21:32:28.496 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-08T21:32:28.517 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-08T21:32:28.630 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:28.756 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-08T21:32:28.882 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-08T21:32:28.978 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:29.320 INFO:teuthology.orchestra.run.smithi119.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-08T21:32:29.348 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-08T21:32:29.404 INFO:teuthology.orchestra.run.smithi119.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-08T21:32:29.404 INFO:teuthology.orchestra.run.smithi119.stdout:This user must also own the server process. 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout:The database cluster will be initialized with locale "en_US". 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout:The default text search configuration will be set to "english". 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout:Data page checksums are disabled. 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:29.405 INFO:teuthology.orchestra.run.smithi119.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-08T21:32:29.406 INFO:teuthology.orchestra.run.smithi119.stdout:creating subdirectories ... ok 2024-03-08T21:32:29.406 INFO:teuthology.orchestra.run.smithi119.stdout:selecting dynamic shared memory implementation ... posix 2024-03-08T21:32:29.429 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default max_connections ... 100 2024-03-08T21:32:29.462 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default shared_buffers ... 128MB 2024-03-08T21:32:29.475 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default time zone ... Etc/UTC 2024-03-08T21:32:29.476 INFO:teuthology.orchestra.run.smithi119.stdout:creating configuration files ... ok 2024-03-08T21:32:29.600 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-08T21:32:29.640 INFO:teuthology.orchestra.run.smithi119.stdout:running bootstrap script ... ok 2024-03-08T21:32:29.729 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up dump (0.4b47-3) ... 2024-03-08T21:32:29.824 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-08T21:32:29.889 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:30.015 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-08T21:32:30.141 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-08T21:32:30.267 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-08T21:32:30.271 INFO:teuthology.orchestra.run.smithi119.stdout:performing post-bootstrap initialization ... ok 2024-03-08T21:32:30.376 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-08T21:32:30.458 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-08T21:32:30.528 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-08T21:32:30.645 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-08T21:32:30.797 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-08T21:32:30.826 INFO:teuthology.orchestra.run.smithi119.stdout:syncing data to disk ... ok 2024-03-08T21:32:30.898 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:31.040 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-08T21:32:31.208 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-client (14+238) ... 2024-03-08T21:32:31.334 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-08T21:32:31.361 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout:which means they are currently configured by ifupdown: 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout:- enp3s0f1 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-08T21:32:32.156 INFO:teuthology.orchestra.run.smithi160.stdout:remove their configuration from /etc/network/interfaces. 2024-03-08T21:32:32.157 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:32.298 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-08T21:32:32.709 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-08T21:32:33.117 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-08T21:32:33.854 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-08T21:32:34.006 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-08T21:32:34.131 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-08T21:32:34.240 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-common (238) ... 2024-03-08T21:32:34.693 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:34.819 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-08T21:32:34.945 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql (14+238) ... 2024-03-08T21:32:35.071 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:35.191 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:35.259 INFO:teuthology.orchestra.run.smithi160.stdout:Adding user postgres to group ssl-cert 2024-03-08T21:32:35.451 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-08T21:32:35.451 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-08T21:32:35.522 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:35.522 INFO:teuthology.orchestra.run.smithi160.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-08T21:32:35.773 INFO:teuthology.orchestra.run.smithi160.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-08T21:32:35.773 INFO:teuthology.orchestra.run.smithi160.stdout:Removing obsolete dictionary files: 2024-03-08T21:32:36.193 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-08T21:32:36.497 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-08T21:32:36.520 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-08T21:32:36.672 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-08T21:32:36.975 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-08T21:32:37.304 INFO:teuthology.orchestra.run.smithi160.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-08T21:32:37.323 INFO:teuthology.orchestra.run.smithi160.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:This user must also own the server process. 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:The database cluster will be initialized with locale "en_US". 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:The default text search configuration will be set to "english". 2024-03-08T21:32:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:Data page checksums are disabled. 2024-03-08T21:32:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-08T21:32:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:creating subdirectories ... ok 2024-03-08T21:32:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:selecting dynamic shared memory implementation ... posix 2024-03-08T21:32:37.391 INFO:teuthology.orchestra.run.smithi160.stdout:selecting default max_connections ... 100 2024-03-08T21:32:37.424 INFO:teuthology.orchestra.run.smithi160.stdout:selecting default shared_buffers ... 128MB 2024-03-08T21:32:37.438 INFO:teuthology.orchestra.run.smithi160.stdout:selecting default time zone ... Etc/UTC 2024-03-08T21:32:37.439 INFO:teuthology.orchestra.run.smithi160.stdout:creating configuration files ... ok 2024-03-08T21:32:37.601 INFO:teuthology.orchestra.run.smithi160.stdout:running bootstrap script ... ok 2024-03-08T21:32:38.041 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-08T21:32:38.133 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-08T21:32:38.194 INFO:teuthology.orchestra.run.smithi160.stdout:performing post-bootstrap initialization ... ok 2024-03-08T21:32:38.651 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-08T21:32:38.658 DEBUG:teuthology.parallel:result is None 2024-03-08T21:32:38.739 INFO:teuthology.orchestra.run.smithi160.stdout:syncing data to disk ... ok 2024-03-08T21:32:39.270 INFO:teuthology.orchestra.run.smithi160.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-08T21:32:42.282 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:42.383 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-08T21:32:42.483 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up postgresql (14+238) ... 2024-03-08T21:32:42.593 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-08T21:32:42.719 INFO:teuthology.orchestra.run.smithi160.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-08T21:32:42.978 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-08T21:32:42.978 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-08T21:32:43.746 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-08T21:32:44.058 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-08T21:32:44.193 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-08T21:32:45.570 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-08T21:32:45.670 INFO:teuthology.orchestra.run.smithi160.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-08T21:32:46.222 INFO:teuthology.orchestra.run.smithi160.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-08T21:32:46.228 DEBUG:teuthology.parallel:result is None 2024-03-08T21:32:46.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T21:32:46.374 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2024-03-08T21:32:46.398 INFO:teuthology.orchestra.run.smithi119.stdout:19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:32:46.398 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:32:46.399 INFO:teuthology.task.install:The correct ceph version 19.0.0-1965-g7d63482a-1jammy is installed. 2024-03-08T21:32:46.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7d63482aa89628d733e298984a762389b625c761 2024-03-08T21:32:46.538 DEBUG:teuthology.orchestra.run.smithi160:> dpkg-query -W -f '${Version}' ceph 2024-03-08T21:32:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:32:46.559 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1965-g7d63482a-1jammy 2024-03-08T21:32:46.559 INFO:teuthology.task.install:The correct ceph version 19.0.0-1965-g7d63482a-1jammy is installed. 2024-03-08T21:32:46.561 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-08T21:32:46.561 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:46.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T21:32:46.582 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:46.583 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T21:32:46.622 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-08T21:32:46.622 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:46.622 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T21:32:46.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T21:32:46.718 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:46.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T21:32:46.737 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T21:32:46.803 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-08T21:32:46.803 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:46.803 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T21:32:46.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T21:32:46.890 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:46.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T21:32:46.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T21:32:46.966 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-08T21:32:46.967 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:46.967 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T21:32:46.987 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T21:32:47.054 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:47.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T21:32:47.072 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T21:32:47.131 INFO:teuthology.run_tasks:Running task ceph... 2024-03-08T21:32:47.207 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-08T21:32:47.207 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-03-08T21:32:47.210 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-03-08T21:32:47.228 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-08T21:32:47.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T21:32:47.277 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T21:32:47.296 INFO:tasks.ceph:Creating extra log directories... 2024-03-08T21:32:47.296 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T21:32:47.345 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T21:32:47.369 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-08T21:32:47.370 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-08T21:32:47.370 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-08T21:32:47.370 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:47.370 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T21:32:47.414 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T21:32:47.505 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:47.506 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T21:32:47.514 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T21:32:47.605 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-08T21:32:47.605 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-08T21:32:47.605 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173', 'branch': 'rishabh-2024mar8', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell}', 'email': None, 'first_in_suite': False, 'job_id': '7588173', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-2024mar8'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7d63482aa89628d733e298984a762389b625c761'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2024mar8', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1249, 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'sleep_before_teardown': 0, 'subset': '481/512', 'suite': 'fs', 'suite_branch': 'rishabh-2024mar8', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7d63482aa89628d733e298984a762389b625c761', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFzhmpaqx9Ga6rr4MqgFLMzouG7pygibGhHYEDeobfgzfDup8t2qKYmiGVgy7ah0fFosDEn+ex7uSea0vKL6J0=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOg+bOf8gOAeVh18+183N9yHnU2HFfayfIdeaJaw8iBQSBziEoIdoooAdK/KszCtLUFyHk7L/7dQ++kzyXcIdNI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7d63482aa89628d733e298984a762389b625c761'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '7d63482aa89628d733e298984a762389b625c761', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-08_19:54:47', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-08T21:32:47.606 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T21:32:47.609 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T21:32:47.652 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T21:32:47.660 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T21:32:47.711 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:47.711 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T21:32:47.730 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T21:32:47.730 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-03-08T21:32:47.782 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T21:32:47.782 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:47.782 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-03-08T21:32:47.783 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:47.783 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-03-08 21:26:22.176655884 +0000 2024-03-08T21:32:47.783 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-03-08 21:26:21.904658313 +0000 2024-03-08T21:32:47.783 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-03-08 21:26:21.904658313 +0000 2024-03-08T21:32:47.783 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-03-08 21:26:21.904658313 +0000 2024-03-08T21:32:47.783 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T21:32:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-03-08T21:32:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-03-08T21:32:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000386894 s, 1.3 MB/s 2024-03-08T21:32:47.846 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T21:32:47.896 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-03-08 21:26:22.688651310 +0000 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-03-08 21:26:22.444653491 +0000 2024-03-08T21:32:47.947 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-03-08 21:26:22.444653491 +0000 2024-03-08T21:32:47.948 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-03-08 21:26:22.444653491 +0000 2024-03-08T21:32:47.948 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T21:32:48.009 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-03-08T21:32:48.009 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-03-08T21:32:48.009 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000382471 s, 1.3 MB/s 2024-03-08T21:32:48.011 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T21:32:48.064 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-03-08 21:26:23.212646630 +0000 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-03-08 21:26:22.944649024 +0000 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-03-08 21:26:22.944649024 +0000 2024-03-08T21:32:48.115 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-03-08 21:26:22.944649024 +0000 2024-03-08T21:32:48.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T21:32:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-03-08T21:32:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-03-08T21:32:48.177 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000637234 s, 803 kB/s 2024-03-08T21:32:48.178 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T21:32:48.232 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-03-08T21:32:48.286 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 950 Links: 1 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-03-08 21:26:23.776641593 +0000 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-03-08 21:26:23.488644164 +0000 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-03-08 21:26:23.488644164 +0000 2024-03-08T21:32:48.287 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-03-08 21:26:23.488644164 +0000 2024-03-08T21:32:48.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T21:32:48.348 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-03-08T21:32:48.348 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-03-08T21:32:48.349 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000389821 s, 1.3 MB/s 2024-03-08T21:32:48.350 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T21:32:48.404 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:48.405 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:48.405 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T21:32:48.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T21:32:48.413 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-03-08 21:26:22.591962474 +0000 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-03-08 21:26:22.327964832 +0000 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-03-08 21:26:22.327964832 +0000 2024-03-08T21:32:48.466 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-03-08 21:26:22.327964832 +0000 2024-03-08T21:32:48.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T21:32:48.526 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-03-08T21:32:48.526 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-03-08T21:32:48.526 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000391291 s, 1.3 MB/s 2024-03-08T21:32:48.528 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T21:32:48.578 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-03-08 21:26:23.091958008 +0000 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-03-08 21:26:22.847960188 +0000 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-03-08 21:26:22.847960188 +0000 2024-03-08T21:32:48.633 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-03-08 21:26:22.847960188 +0000 2024-03-08T21:32:48.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T21:32:48.694 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-03-08T21:32:48.694 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-03-08T21:32:48.694 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000372723 s, 1.4 MB/s 2024-03-08T21:32:48.695 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T21:32:48.747 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-03-08 21:26:23.607953399 +0000 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-03-08 21:26:23.339955793 +0000 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-03-08 21:26:23.339955793 +0000 2024-03-08T21:32:48.801 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-03-08 21:26:23.339955793 +0000 2024-03-08T21:32:48.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T21:32:48.862 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-03-08T21:32:48.862 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-03-08T21:32:48.862 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000350826 s, 1.5 MB/s 2024-03-08T21:32:48.864 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T21:32:48.914 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-03-08T21:32:48.964 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 953 Links: 1 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-03-08 21:26:24.099949004 +0000 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-03-08 21:26:23.847951255 +0000 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-03-08 21:26:23.847951255 +0000 2024-03-08T21:32:48.965 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-03-08 21:26:23.847951255 +0000 2024-03-08T21:32:48.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T21:32:49.021 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-03-08T21:32:49.022 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-03-08T21:32:49.022 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000347321 s, 1.5 MB/s 2024-03-08T21:32:49.023 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T21:32:49.078 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:49.078 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T21:32:49.078 INFO:tasks.ceph:Generating config... 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] debug client = 20 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] debug ms = 1 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] pid file = 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-08T21:32:49.080 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-08T21:32:49.080 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-08T21:32:49.081 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-08T21:32:49.082 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-08T21:32:49.082 INFO:tasks.ceph:Setting up mon.a... 2024-03-08T21:32:49.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-08T21:32:49.127 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.keyring 2024-03-08T21:32:49.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-08T21:32:49.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T21:32:49.273 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.119'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2024-03-08T21:32:49.274 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.119,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-08T21:32:49.275 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:49.275 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T21:32:49.326 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.119 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: generated fsid b59e109d-7f9b-46a7-b423-bd44b3e2407a 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:setting min_mon_release = quincy 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:epoch 0 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:fsid b59e109d-7f9b-46a7-b423-bd44b3e2407a 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:last_changed 2024-03-08T21:32:49.437481+0000 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:created 2024-03-08T21:32:49.437481+0000 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:min_mon_release 17 (quincy) 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:election_strategy: 1 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:0: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.a 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2024-03-08T21:32:49.417 INFO:teuthology.orchestra.run.smithi119.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-08T21:32:49.420 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T21:32:49.427 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b59e109d-7f9b-46a7-b423-bd44b3e2407a... 2024-03-08T21:32:49.428 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T21:32:49.477 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T21:32:49.515 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-03-08T21:32:49.515 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.516 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-03-08T21:32:49.517 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-03-08T21:32:49.518 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.119,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = b59e109d-7f9b-46a7-b423-bd44b3e2407a 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-03-08T21:32:49.519 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-03-08T21:32:49.520 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-03-08T21:32:49.521 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-03-08T21:32:49.522 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.523 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-03-08T21:32:49.524 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T21:32:49.525 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T21:32:49.526 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-03-08T21:32:49.527 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-03-08T21:32:49.528 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-03-08T21:32:49.529 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-03-08T21:32:49.530 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.119,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-03-08T21:32:49.531 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = b59e109d-7f9b-46a7-b423-bd44b3e2407a 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2024-03-08T21:32:49.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: bdev async discard = True 2024-03-08T21:32:49.533 INFO:teuthology.orchestra.run.smithi160.stdout: bdev enable discard = True 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore allocator = bitmap 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 1/20 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 1/20 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 4/10 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2024-03-08T21:32:49.534 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-03-08T21:32:49.535 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-03-08T21:32:49.536 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T21:32:49.537 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T21:32:49.538 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2024-03-08T21:32:49.539 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2024-03-08T21:32:49.540 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2024-03-08T21:32:49.541 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2024-03-08T21:32:49.542 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-08T21:32:49.542 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-08T21:32:49.641 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-08T21:32:49.641 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:49.641 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-08T21:32:49.649 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:49.650 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-08T21:32:49.698 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:32:49.699 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:49.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T21:32:49.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T21:32:49.773 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:32:49.773 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:49.826 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:32:49.826 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:49.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T21:32:49.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T21:32:49.859 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:32:49.859 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:49.909 INFO:tasks.ceph:Setting up mon nodes... 2024-03-08T21:32:49.909 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-08T21:32:49.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T21:32:49.961 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T21:32:49.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T21:32:50.023 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T21:32:50.035 INFO:tasks.ceph:Setting up mds nodes... 2024-03-08T21:32:50.036 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T21:32:50.089 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T21:32:50.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-08T21:32:50.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T21:32:50.168 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T21:32:50.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-08T21:32:50.191 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-08T21:32:50.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-08T21:32:50.233 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-08T21:32:50.250 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-08T21:32:50.250 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T21:32:50.250 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-08T21:32:50.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:50.312 INFO:tasks.ceph:role: osd.0 2024-03-08T21:32:50.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:32:50.313 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T21:32:50.380 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:32:50.380 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:32:50.380 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:32:50.381 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:32:50.836 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-03-08T21:32:50.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-03-08T21:32:50.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-08T21:32:50.972 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-08T21:32:50.987 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:32:50.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:32:50.989 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-08T21:32:51.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:51.048 INFO:tasks.ceph:role: osd.1 2024-03-08T21:32:51.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:32:51.049 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:32:51.116 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:32:51.117 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:32:51.117 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:32:51.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:32:51.117 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:32:51.552 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-03-08T21:32:51.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-03-08T21:32:51.555 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-08T21:32:51.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-08T21:32:51.694 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:32:51.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:32:51.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-08T21:32:51.757 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:51.757 INFO:tasks.ceph:role: osd.2 2024-03-08T21:32:51.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:32:51.757 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T21:32:51.824 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:32:51.824 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:32:51.824 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:32:51.824 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:32:51.825 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:32:52.305 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-03-08T21:32:52.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-03-08T21:32:52.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-08T21:32:52.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-08T21:32:52.426 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:32:52.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:32:52.428 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-08T21:32:52.490 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T21:32:52.490 INFO:tasks.ceph:role: osd.3 2024-03-08T21:32:52.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:32:52.490 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T21:32:52.562 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:32:52.563 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:32:53.057 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-03-08T21:32:53.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-03-08T21:32:53.060 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-08T21:32:53.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-08T21:32:53.234 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:32:53.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:32:53.235 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:53.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.388+0000 7f6d7c42d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-08T21:32:53.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.388+0000 7f6d7c42d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-08T21:32:53.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.388+0000 7f6d7c42d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T21:32:53.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.388+0000 7f6d7c42d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T21:32:53.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.388+0000 7f6d7c42d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T21:32:53.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:53.400+0000 7f6d7c42d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-08T21:32:56.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-08T21:32:56.377 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:56.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.484+0000 7f04f43387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-08T21:32:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.484+0000 7f04f43387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-08T21:32:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.484+0000 7f04f43387c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T21:32:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.484+0000 7f04f43387c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T21:32:56.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.484+0000 7f04f43387c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T21:32:56.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:56.488+0000 7f04f43387c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-08T21:32:59.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-08T21:32:59.456 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:32:59.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-08T21:32:59.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-08T21:32:59.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T21:32:59.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T21:32:59.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T21:32:59.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:32:59.564+0000 7f022eb8f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-08T21:33:02.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-08T21:33:02.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:02.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-08T21:33:02.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-08T21:33:02.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T21:33:02.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T21:33:02.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T21:33:02.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:02.664+0000 7f4dd25577c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-08T21:33:05.629 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-08T21:33:05.650 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-08T21:33:05.671 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T21:33:05.672 INFO:tasks.ceph:role: osd.4 2024-03-08T21:33:05.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:33:05.672 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T21:33:05.740 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:33:05.740 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:33:05.741 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:33:06.198 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-03-08T21:33:06.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-03-08T21:33:06.201 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-08T21:33:06.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-08T21:33:06.329 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:33:06.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:33:06.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-08T21:33:06.392 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T21:33:06.393 INFO:tasks.ceph:role: osd.5 2024-03-08T21:33:06.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:33:06.393 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T21:33:06.460 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:33:06.461 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:33:06.942 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-03-08T21:33:06.945 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-03-08T21:33:06.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-08T21:33:07.102 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-08T21:33:07.118 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:33:07.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:33:07.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-08T21:33:07.180 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T21:33:07.180 INFO:tasks.ceph:role: osd.6 2024-03-08T21:33:07.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:33:07.181 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T21:33:07.247 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:33:07.247 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:33:07.247 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:33:07.248 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:33:07.732 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-03-08T21:33:07.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-03-08T21:33:07.735 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-08T21:33:07.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-08T21:33:07.892 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:33:07.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:33:07.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-08T21:33:07.956 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T21:33:07.956 INFO:tasks.ceph:role: osd.7 2024-03-08T21:33:07.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:33:07.956 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T21:33:08.024 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T21:33:08.473 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-03-08T21:33:08.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-03-08T21:33:08.476 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-08T21:33:08.575 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-08T21:33:08.592 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: /sbin/restorecon: command not found 2024-03-08T21:33:08.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:33:08.593 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:08.715 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.730+0000 7fcc1f7ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-08T21:33:08.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.730+0000 7fcc1f7ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-08T21:33:08.717 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.730+0000 7fcc1f7ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T21:33:08.717 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.730+0000 7fcc1f7ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T21:33:08.717 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.730+0000 7fcc1f7ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T21:33:08.718 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:08.734+0000 7fcc1f7ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-08T21:33:11.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-08T21:33:11.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:11.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.826+0000 7ff853c2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-08T21:33:11.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.826+0000 7ff853c2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-08T21:33:11.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.826+0000 7ff853c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T21:33:11.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.826+0000 7ff853c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T21:33:11.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.826+0000 7ff853c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T21:33:11.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:11.830+0000 7ff853c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-08T21:33:14.779 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-08T21:33:14.799 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:14.890 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-08T21:33:14.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-08T21:33:14.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T21:33:14.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T21:33:14.891 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T21:33:14.892 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:14.906+0000 7feca6f347c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-08T21:33:17.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:33:17.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:33:17.858 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-08T21:33:17.877 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-08T21:33:17.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-08T21:33:17.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T21:33:17.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T21:33:17.972 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T21:33:17.973 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:17.986+0000 7f50324727c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-08T21:33:20.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-08T21:33:20.959 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-08T21:33:20.959 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:20.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-08T21:33:20.981 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:20.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-08T21:33:21.042 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:21.042 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-08T21:33:21.110 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:21.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-08T21:33:21.173 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:21.174 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-08T21:33:21.234 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:21.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-08T21:33:21.297 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-08T21:33:21.317 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.317 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-08T21:33:21.381 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.382 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-08T21:33:21.445 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.445 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-08T21:33:21.505 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.505 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-08T21:33:21.565 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:21.565 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-08T21:33:21.629 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:21.629 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-08T21:33:21.638 INFO:tasks.ceph:Adding keys to all mons... 2024-03-08T21:33:21.638 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T21:33:21.685 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T21:33:21.700 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQABhOtlVoqLOhAAaGWMOo6MoWIXlRCw3n8x/A== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAChOtlY12TBhAAn0kx0+ksiHAFJKh8GVAtpQ== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAFhOtlHFBkFxAAEcq02Y3WFI5K6n+MuEIoDQ== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAIhOtl1B4oHRAAeMgCpSTfbyIHGP6i0RR3Pw== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQALhOtlR/rSIRAAKl9zzcA+lt40OMrvWvptWQ== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAOhOtlV5jOJxAAY4euw+gZXZLrtqNDI51SHw== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAChOtlmkJ/AhAAFFLqfWIRVTBRT21l6bos6A== 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-03-08T21:33:21.701 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAChOtlpC8qCxAAAhxEEOqRipl6e9evxf56RQ== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAUhOtlhQnBKxAAqii6bYDAxAPy7EL7r4LkCQ== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAXhOtlDBB4MRAA/QGz2XvWC01zy7GDaprezQ== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAahOtlZtUrNhAADi6IwmFkw1S2CK4IdDlIuw== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAdhOtlhS71OhAA/1hG6LLZZcIYtwZS8jDfgg== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAChOtlvC0jDxAA1g3YPVNdL51JtIDGrFOacQ== 2024-03-08T21:33:21.702 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQABhOtlVoqLOhAAaGWMOo6MoWIXlRCw3n8x/A== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAChOtlY12TBhAAn0kx0+ksiHAFJKh8GVAtpQ== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAFhOtlHFBkFxAAEcq02Y3WFI5K6n+MuEIoDQ== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAIhOtl1B4oHRAAeMgCpSTfbyIHGP6i0RR3Pw== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQALhOtlR/rSIRAAKl9zzcA+lt40OMrvWvptWQ== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAOhOtlV5jOJxAAY4euw+gZXZLrtqNDI51SHw== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAChOtlmkJ/AhAAFFLqfWIRVTBRT21l6bos6A== 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-03-08T21:33:21.703 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAChOtlpC8qCxAAAhxEEOqRipl6e9evxf56RQ== 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAUhOtlhQnBKxAAqii6bYDAxAPy7EL7r4LkCQ== 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAXhOtlDBB4MRAA/QGz2XvWC01zy7GDaprezQ== 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAahOtlZtUrNhAADi6IwmFkw1S2CK4IdDlIuw== 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAdhOtlhS71OhAA/1hG6LLZZcIYtwZS8jDfgg== 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2024-03-08T21:33:21.704 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAChOtlvC0jDxAA1g3YPVNdL51JtIDGrFOacQ== 2024-03-08T21:33:21.705 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T21:33:21.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T21:33:21.807 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T21:33:21.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T21:33:21.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:21.870 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:21.923 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:21.926 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:21.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:21.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.034 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.088 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T21:33:22.092 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T21:33:22.143 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T21:33:22.147 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T21:33:22.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.205 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.257 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.260 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.312 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.315 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.367 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.370 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T21:33:22.423 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T21:33:22.426 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T21:33:22.484 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-08T21:33:22.485 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-08T21:33:22.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T21:33:22.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-08T21:33:22.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-08T21:33:22.654 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T21:33:22.763 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-08T21:33:22.783 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-08T21:33:22.844 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T21:33:22.949 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-08T21:33:22.969 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:22.972 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T21:33:23.017 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-08T21:33:23.018 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-08T21:33:23.018 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-08T21:33:23.020 INFO:tasks.ceph.mon.a:Started 2024-03-08T21:33:23.021 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-08T21:33:23.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-08T21:33:23.064 INFO:tasks.ceph.mon.b:Started 2024-03-08T21:33:23.064 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-08T21:33:23.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-08T21:33:23.067 INFO:tasks.ceph.mon.c:Started 2024-03-08T21:33:23.067 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-08T21:33:23.068 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-08T21:33:23.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-08T21:33:23.071 INFO:tasks.ceph.mgr.y:Started 2024-03-08T21:33:23.071 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-08T21:33:23.071 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-08T21:33:23.074 INFO:tasks.ceph.mgr.x:Started 2024-03-08T21:33:23.074 INFO:tasks.ceph:Setting crush tunables to default 2024-03-08T21:33:23.074 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd crush tunables default 2024-03-08T21:33:23.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.227+0000 7f7ef0a00640 1 Processor -- start 2024-03-08T21:33:23.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.227+0000 7f7ef0a00640 1 -- start start 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ef0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ef0a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 0x7f7eec1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ef0a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec144a00 con 0x7f7eec140fb0 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ef0a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec06cc20 con 0x7f7eec06c840 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ef0a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0b3670 con 0x7f7eec144030 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60720/0 (socket says 172.21.15.119:60720) 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 -- 172.21.15.119:0/689019565 learned_addr learned my addr 172.21.15.119:0/689019565 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee1400640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 0x7f7eec1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 msgr2=0x7f7eec0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 msgr2=0x7f7eec0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-08T21:33:23.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee1400640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 msgr2=0x7f7eec1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-08T21:33:23.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee1400640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 msgr2=0x7f7eec1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-08T21:33:23.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee1400640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 0x7f7eec1444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-08T21:33:23.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee1400640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 0x7f7eec1444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-08T21:33:23.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.231+0000 7f7ee9e00640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-08T21:33:23.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.387+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132263395 0 0) 0x7f7eec144a00 con 0x7f7eec140fb0 2024-03-08T21:33:23.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.387+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003530 con 0x7f7eec140fb0 2024-03-08T21:33:23.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754601676 0 0) 0x7f7ed0003530 con 0x7f7eec140fb0 2024-03-08T21:33:23.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 msgr2=0x7f7eec1444c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.160:3300/0 conn(0x7f7eec144030 0x7f7eec1444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 msgr2=0x7f7eec0b3090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 --2- 172.21.15.119:0/689019565 >> v2:172.21.15.119:3300/0 conn(0x7f7eec06c840 0x7f7eec0b3090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0b3950 con 0x7f7eec140fb0 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f7ee4001680 con 0x7f7eec140fb0 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 >> v1:172.21.15.160:6789/0 conn(0x7f7eec140fb0 legacy=0x7f7eec1413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed0003a10 0x7f7ed0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0004810 0x7f7ed0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 0x7f7ed000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec06cc20 con 0x7f7ed0005220 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0b3670 con 0x7f7ed0004810 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed000c1d0 con 0x7f7ed0003a10 2024-03-08T21:33:23.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 0x7f7ed000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee1400640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0004810 0x7f7ed0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9e00640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed0003a10 0x7f7ed0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 -- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed0003a10 msgr2=0x7f7ed0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed0003a10 0x7f7ed0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 -- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0004810 msgr2=0x7f7ed0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0004810 0x7f7ed0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7eea800640 1 -- 172.21.15.119:0/689019565 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0003530 con 0x7f7ed0005220 2024-03-08T21:33:23.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.391+0000 7f7ee9e00640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed0003a10 0x7f7ed0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:23.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.395+0000 7f7eea800640 1 -- 172.21.15.119:0/689019565 reap_dead start 2024-03-08T21:33:23.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.395+0000 7f7eea800640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 0x7f7ed000b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007b60 tx=0x7f7ee4021480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261fdb1cd2559624 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:23.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4007ba0 con 0x7f7ed0005220 2024-03-08T21:33:23.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40b1660 con 0x7f7ed0005220 2024-03-08T21:33:23.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ee9400640 1 -- 172.21.15.119:0/689019565 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40b1a50 con 0x7f7ed0005220 2024-03-08T21:33:23.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 msgr2=0x7f7ed000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:23.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 0x7f7ed000b9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4007b60 tx=0x7f7ee4021480 comp rx=0 tx=0).stop 2024-03-08T21:33:23.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- 172.21.15.119:0/689019565 shutdown_connections 2024-03-08T21:33:23.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/689019565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ed0005220 0x7f7ed000b9d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- 172.21.15.119:0/689019565 >> 172.21.15.119:0/689019565 conn(0x7f7eec09a230 msgr2=0x7f7eec09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:23.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- 172.21.15.119:0/689019565 shutdown_connections 2024-03-08T21:33:23.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- 172.21.15.119:0/689019565 wait complete. 2024-03-08T21:33:23.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 Processor -- start 2024-03-08T21:33:23.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.399+0000 7f7ef0a00640 1 -- start start 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0005220 0x7f7eec147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eec1cdfd0 0x7f7eec071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec09da70 con 0x7f7eec072220 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec09d8f0 con 0x7f7ed0005220 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec0b3090 con 0x7f7eec1cdfd0 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60758/0 (socket says 172.21.15.119:60758) 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 -- 172.21.15.119:0/1834924751 learned_addr learned my addr 172.21.15.119:0/1834924751 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:23.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee9e00640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0005220 0x7f7eec147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee1400640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eec1cdfd0 0x7f7eec071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 -- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eec1cdfd0 msgr2=0x7f7eec071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eec1cdfd0 0x7f7eec071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 -- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0005220 msgr2=0x7f7eec147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0005220 0x7f7eec147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 -- 172.21.15.119:0/1834924751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec072890 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7eea800640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c1a0 tx=0x7f7ed0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40bf070 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4005070 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4007ba0 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec1ce750 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec070dd0 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7ee40b1660 con 0x7f7eec072220 2024-03-08T21:33:23.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7ee4003920 con 0x7f7eec072220 2024-03-08T21:33:23.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.403+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec067db0 con 0x7f7eec072220 2024-03-08T21:33:23.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.407+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f7ee401b190 con 0x7f7eec072220 2024-03-08T21:33:23.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.467+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7eec0b8260 con 0x7f7eec072220 2024-03-08T21:33:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ee2a00640 1 -- 172.21.15.119:0/1834924751 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7ee4005420 con 0x7f7eec072220 2024-03-08T21:33:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:adjusted tunables profile to default 2024-03-08T21:33:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 msgr2=0x7f7eec06f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c1a0 tx=0x7f7ed0005840 comp rx=0 tx=0).stop 2024-03-08T21:33:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 shutdown_connections 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7eec072220 0x7f7eec06f820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eec1cdfd0 0x7f7eec071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 --2- 172.21.15.119:0/1834924751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed0005220 0x7f7eec147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 >> 172.21.15.119:0/1834924751 conn(0x7f7eec09a230 msgr2=0x7f7eec0b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 shutdown_connections 2024-03-08T21:33:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:23.471+0000 7f7ef0a00640 1 -- 172.21.15.119:0/1834924751 wait complete. 2024-03-08T21:33:23.479 INFO:tasks.ceph:check_enable_crimson: False 2024-03-08T21:33:23.479 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-08T21:33:23.479 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:23.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-08T21:33:23.499 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:23.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-08T21:33:23.561 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:23.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-08T21:33:23.595 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:23.609+0000 7f35f5bfb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T21:33:23.600 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:23.615+0000 7ffa7b414180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T21:33:23.619 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:33:23.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-08T21:33:23.681 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:23.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-08T21:33:23.701 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:23.701 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-08T21:33:23.761 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:23.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-08T21:33:23.825 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-03-08T21:33:23.825 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-08T21:33:23.885 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 0fbf591f-25a6-4dde-b8a9-83ab24ab45bd 0 2024-03-08T21:33:24.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 Processor -- start 2024-03-08T21:33:24.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 -- start start 2024-03-08T21:33:24.065 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbd00b3650 0x7ffbd01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd00b54b0 con 0x7ffbd00b43c0 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd00b47a0 con 0x7ffbd0145910 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbd5c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd00b2bb0 con 0x7ffbd00b3650 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbcf400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ffbd0145910 0x7ffbd014fb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:34090/0 (socket says 172.21.15.160:34090) 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbcf400640 1 -- 172.21.15.160:0/2588833349 learned_addr learned my addr 172.21.15.160:0/2588833349 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbc7e00640 1 --2- 172.21.15.160:0/2588833349 >> v2:172.21.15.119:3300/0 conn(0x7ffbd00b3650 0x7ffbd01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581513625 0 0) 0x7ffbd00b47a0 con 0x7ffbd0145910 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb4003530 con 0x7ffbd0145910 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804990550 0 0) 0x7ffbd00b54b0 con 0x7ffbd00b43c0 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd00b47a0 con 0x7ffbd00b43c0 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbc7e00640 1 -- 172.21.15.160:0/2588833349 >> v1:172.21.15.160:6789/0 conn(0x7ffbd0145910 legacy=0x7ffbd014fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbc7e00640 1 -- 172.21.15.160:0/2588833349 >> v1:172.21.15.119:6789/0 conn(0x7ffbd00b43c0 legacy=0x7ffbd00b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.077+0000 7ffbc7e00640 1 -- 172.21.15.160:0/2588833349 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00b2e90 con 0x7ffbd00b3650 2024-03-08T21:33:24.069 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbc7e00640 1 --2- 172.21.15.160:0/2588833349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd01453d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80097f0 tx=0x7ffbb801cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b75d28b9b0ba1c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.069 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80b1070 con 0x7ffbd00b3650 2024-03-08T21:33:24.069 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb80ac600 con 0x7ffbd00b3650 2024-03-08T21:33:24.069 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbce000640 1 -- 172.21.15.160:0/2588833349 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80ac9d0 con 0x7ffbd00b3650 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 -- 172.21.15.160:0/2588833349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 msgr2=0x7ffbd01453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/2588833349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd01453d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80097f0 tx=0x7ffbb801cde0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 -- 172.21.15.160:0/2588833349 shutdown_connections 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/2588833349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd01453d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 -- 172.21.15.160:0/2588833349 >> 172.21.15.160:0/2588833349 conn(0x7ffbd006b5d0 msgr2=0x7ffbd00ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 -- 172.21.15.160:0/2588833349 shutdown_connections 2024-03-08T21:33:24.070 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.081+0000 7ffbd5c00640 1 -- 172.21.15.160:0/2588833349 wait complete. 2024-03-08T21:33:24.071 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 Processor -- start 2024-03-08T21:33:24.071 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- start start 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd013fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 0x7ffbd013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0071910 con 0x7ffbd00b3650 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00b6d50 con 0x7ffbd00b43c0 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00b3b00 con 0x7ffbd0145910 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 0x7ffbd013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40816/0 (socket says 172.21.15.160:40816) 2024-03-08T21:33:24.073 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 -- 172.21.15.160:0/1054746582 learned_addr learned my addr 172.21.15.160:0/1054746582 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcea00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd013fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 -- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 msgr2=0x7ffbd013bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 0x7ffbd013bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 -- 172.21.15.160:0/1054746582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 msgr2=0x7ffbd013fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd013fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 -- 172.21.15.160:0/1054746582 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd013f020 con 0x7ffbd0145910 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc7e00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 0x7ffbd013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcea00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd013fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:24.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbcf400640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800cad0 tx=0x7ffbc800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8017070 con 0x7ffbd0145910 2024-03-08T21:33:24.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800ac50 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd013f300 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8012400 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd0140220 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ffbc801a070 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.085+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffbc801cc10 con 0x7ffbd0145910 2024-03-08T21:33:24.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.089+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd0067db0 con 0x7ffbd0145910 2024-03-08T21:33:24.086 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.101+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ffbc8021070 con 0x7ffbd0145910 2024-03-08T21:33:24.092 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:24.107+0000 7ffa7b414180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T21:33:24.109 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:24.121+0000 7f35f5bfb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T21:33:24.153 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.165+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0fbf591f-25a6-4dde-b8a9-83ab24ab45bd", "id": 0} v 0) v1 -- 0x7ffbd013d130 con 0x7ffbd0145910 2024-03-08T21:33:24.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbc6a00640 1 -- 172.21.15.160:0/1054746582 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fbf591f-25a6-4dde-b8a9-83ab24ab45bd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffbd013f020 con 0x7ffbd0145910 2024-03-08T21:33:24.159 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 msgr2=0x7ffbd013c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800cad0 tx=0x7ffbc800cf90 comp rx=0 tx=0).stop 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 shutdown_connections 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbd0145910 0x7ffbd013c080 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbd00b43c0 0x7ffbd013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 --2- 172.21.15.160:0/1054746582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbd00b3650 0x7ffbd013fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 >> 172.21.15.160:0/1054746582 conn(0x7ffbd006b5d0 msgr2=0x7ffbd00ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 shutdown_connections 2024-03-08T21:33:24.161 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.173+0000 7ffbd5c00640 1 -- 172.21.15.160:0/1054746582 wait complete. 2024-03-08T21:33:24.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new d76f7ee4-61f5-4e23-873f-40f4785e122c 1 2024-03-08T21:33:24.307 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:24.323+0000 7ffa7b414180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T21:33:24.314 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.325+0000 7f6441e00640 1 Processor -- start 2024-03-08T21:33:24.314 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 -- start start 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f643c0b5040 0x7f643c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f643c06db10 0x7f643c06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c14ac80 con 0x7f643c06d3b0 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c14b290 con 0x7f643c06db10 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6441e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c0adfc0 con 0x7f643c0b5040 2024-03-08T21:33:24.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643aa00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f643c0b5040 0x7f643c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643b400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f643c06d3b0 0x7f643c146fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:34100/0 (socket says 172.21.15.160:34100) 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643b400640 1 -- 172.21.15.160:0/2794632274 learned_addr learned my addr 172.21.15.160:0/2794632274 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643a000640 1 --2- 172.21.15.160:0/2794632274 >> v2:172.21.15.119:3300/0 conn(0x7f643c06db10 0x7f643c06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643aa00640 1 -- 172.21.15.160:0/2794632274 >> v2:172.21.15.119:3300/0 conn(0x7f643c06db10 msgr2=0x7f643c06ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643aa00640 1 --2- 172.21.15.160:0/2794632274 >> v2:172.21.15.119:3300/0 conn(0x7f643c06db10 0x7f643c06ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643aa00640 1 -- 172.21.15.160:0/2794632274 >> v1:172.21.15.160:6789/0 conn(0x7f643c06d3b0 legacy=0x7f643c146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f643aa00640 1 -- 172.21.15.160:0/2794632274 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c14af20 con 0x7f643c0b5040 2024-03-08T21:33:24.317 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.329+0000 7f6439600640 1 -- 172.21.15.160:0/2794632274 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720525751 0 0) 0x7f643c14ac80 con 0x7f643c06d3b0 2024-03-08T21:33:24.319 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f643aa00640 1 --2- 172.21.15.160:0/2794632274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c0b5040 0x7f643c0b5420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f643c14b410 tx=0x7f642c01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=472257dea2e59161 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.319 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6439600640 1 -- 172.21.15.160:0/2794632274 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b0070 con 0x7f643c0b5040 2024-03-08T21:33:24.319 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6439600640 1 -- 172.21.15.160:0/2794632274 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c0ab600 con 0x7f643c0b5040 2024-03-08T21:33:24.319 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6439600640 1 -- 172.21.15.160:0/2794632274 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0a4e60 con 0x7f643c0b5040 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- 172.21.15.160:0/2794632274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c0b5040 msgr2=0x7f643c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 --2- 172.21.15.160:0/2794632274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c0b5040 0x7f643c0b5420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f643c14b410 tx=0x7f642c01c3d0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- 172.21.15.160:0/2794632274 shutdown_connections 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 --2- 172.21.15.160:0/2794632274 >> v2:172.21.15.119:3300/0 conn(0x7f643c06db10 0x7f643c06ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 --2- 172.21.15.160:0/2794632274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c0b5040 0x7f643c0b5420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- 172.21.15.160:0/2794632274 >> 172.21.15.160:0/2794632274 conn(0x7f643c06b5d0 msgr2=0x7f643c0ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- 172.21.15.160:0/2794632274 shutdown_connections 2024-03-08T21:33:24.320 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- 172.21.15.160:0/2794632274 wait complete. 2024-03-08T21:33:24.321 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 Processor -- start 2024-03-08T21:33:24.321 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.333+0000 7f6441e00640 1 -- start start 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 0x7f643c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c0b5040 0x7f643c13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c13def0 con 0x7f643c0b5040 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c13dd70 con 0x7f643c06d3b0 2024-03-08T21:33:24.323 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c154980 con 0x7f643c06db10 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643a000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 0x7f643c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53222/0 (socket says 172.21.15.160:53222) 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 -- 172.21.15.160:0/1600185658 learned_addr learned my addr 172.21.15.160:0/1600185658 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643b400640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c0b5040 0x7f643c13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 -- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 msgr2=0x7f643c0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 0x7f643c0b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 -- 172.21.15.160:0/1600185658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c0b5040 msgr2=0x7f643c13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c0b5040 0x7f643c13e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 -- 172.21.15.160:0/1600185658 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c13f560 con 0x7f643c06d3b0 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643a000640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 0x7f643c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:24.324 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f643aa00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f642c01a000 tx=0x7f642c01ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b0050 con 0x7f643c06d3b0 2024-03-08T21:33:24.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c0bc070 con 0x7f643c06d3b0 2024-03-08T21:33:24.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b5870 con 0x7f643c06d3b0 2024-03-08T21:33:24.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0b4770 con 0x7f643c06d3b0 2024-03-08T21:33:24.325 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c1e3120 con 0x7f643c06d3b0 2024-03-08T21:33:24.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f642c0b5a10 con 0x7f643c06d3b0 2024-03-08T21:33:24.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f642c0b7450 con 0x7f643c06d3b0 2024-03-08T21:33:24.326 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.337+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c067db0 con 0x7f643c06d3b0 2024-03-08T21:33:24.328 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.341+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f642c016050 con 0x7f643c06d3b0 2024-03-08T21:33:24.331 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:24.345+0000 7f35f5bfb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T21:33:24.397 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.409+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d76f7ee4-61f5-4e23-873f-40f4785e122c", "id": 1} v 0) v1 -- 0x7f643c0b3340 con 0x7f643c06d3b0 2024-03-08T21:33:24.401 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.413+0000 7f6433400640 1 -- 172.21.15.160:0/1600185658 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d76f7ee4-61f5-4e23-873f-40f4785e122c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f642c0b5da0 con 0x7f643c06d3b0 2024-03-08T21:33:24.402 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 msgr2=0x7f643c1438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f642c01a000 tx=0x7f642c01ac10 comp rx=0 tx=0).stop 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 shutdown_connections 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f643c0b5040 0x7f643c13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f643c06db10 0x7f643c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 --2- 172.21.15.160:0/1600185658 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f643c06d3b0 0x7f643c1438a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 >> 172.21.15.160:0/1600185658 conn(0x7f643c06b5d0 msgr2=0x7f643c0b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.403 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 shutdown_connections 2024-03-08T21:33:24.404 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.417+0000 7f6441e00640 1 -- 172.21.15.160:0/1600185658 wait complete. 2024-03-08T21:33:24.421 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 6fa49417-d2de-4f3a-be3c-0f49df1ef4ab 2 2024-03-08T21:33:24.554 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 Processor -- start 2024-03-08T21:33:24.555 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 -- start start 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 0x7fd23c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0b54b0 con 0x7fd23c0b3650 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0b2900 con 0x7fd23c0b3ad0 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd241200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b47a0 con 0x7fd23c0b43c0 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.556 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40822/0 (socket says 172.21.15.160:40822) 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 -- 172.21.15.160:0/1046195045 learned_addr learned my addr 172.21.15.160:0/1046195045 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd23a800640 1 --2- 172.21.15.160:0/1046195045 >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 0x7fd23c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 -- 172.21.15.160:0/1046195045 >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 msgr2=0x7fd23c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 --2- 172.21.15.160:0/1046195045 >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 0x7fd23c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 -- 172.21.15.160:0/1046195045 >> v1:172.21.15.119:6789/0 conn(0x7fd23c0b3650 legacy=0x7fd23c1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd239e00640 1 -- 172.21.15.160:0/1046195045 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0b2bb0 con 0x7fd23c0b43c0 2024-03-08T21:33:24.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.569+0000 7fd23a800640 1 --2- 172.21.15.160:0/1046195045 >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 0x7fd23c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd239e00640 1 --2- 172.21.15.160:0/1046195045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b2ae0 tx=0x7fd22c01ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa97b4ee7173149e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd238a00640 1 -- 172.21.15.160:0/1046195045 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0ab610 con 0x7fd23c0b43c0 2024-03-08T21:33:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd238a00640 1 -- 172.21.15.160:0/1046195045 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0b0070 con 0x7fd23c0b43c0 2024-03-08T21:33:24.559 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd238a00640 1 -- 172.21.15.160:0/1046195045 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0ab9d0 con 0x7fd23c0b43c0 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- 172.21.15.160:0/1046195045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 msgr2=0x7fd23c0b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- 172.21.15.160:0/1046195045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b2ae0 tx=0x7fd22c01ce50 comp rx=0 tx=0).stop 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- 172.21.15.160:0/1046195045 shutdown_connections 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- 172.21.15.160:0/1046195045 >> v2:172.21.15.119:3300/0 conn(0x7fd23c0b3ad0 0x7fd23c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- 172.21.15.160:0/1046195045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b43c0 0x7fd23c0b23c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- 172.21.15.160:0/1046195045 >> 172.21.15.160:0/1046195045 conn(0x7fd23c06b5d0 msgr2=0x7fd23c0ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- 172.21.15.160:0/1046195045 shutdown_connections 2024-03-08T21:33:24.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- 172.21.15.160:0/1046195045 wait complete. 2024-03-08T21:33:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 Processor -- start 2024-03-08T21:33:24.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- start start 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd23c0b43c0 0x7fd23c1df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd23c14aed0 0x7fd23c14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.573+0000 7fd241200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c071910 con 0x7fd23c14aed0 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd241200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ae220 con 0x7fd23c0b43c0 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd241200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c149230 con 0x7fd23c0b3650 2024-03-08T21:33:24.563 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40832/0 (socket says 172.21.15.160:40832) 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 -- 172.21.15.160:0/3746099988 learned_addr learned my addr 172.21.15.160:0/3746099988 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd23a800640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd23c14aed0 0x7fd23c14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239400640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd23c0b43c0 0x7fd23c1df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 -- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd23c0b43c0 msgr2=0x7fd23c1df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd23c0b43c0 0x7fd23c1df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 -- 172.21.15.160:0/3746099988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd23c14aed0 msgr2=0x7fd23c14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd23c14aed0 0x7fd23c14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 -- 172.21.15.160:0/3746099988 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c14b400 con 0x7fd23c0b3650 2024-03-08T21:33:24.564 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd239e00640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ad040 tx=0x7fd22c01ac30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0be5f0 con 0x7fd23c0b3650 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0be7b0 con 0x7fd23c0b3650 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0beba0 con 0x7fd23c0b3650 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c14b6e0 con 0x7fd23c0b3650 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0b1350 con 0x7fd23c0b3650 2024-03-08T21:33:24.565 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd22c0c7780 con 0x7fd23c0b3650 2024-03-08T21:33:24.566 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd22c0b43f0 con 0x7fd23c0b3650 2024-03-08T21:33:24.566 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.577+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0b1590 con 0x7fd23c0b3650 2024-03-08T21:33:24.567 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.581+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd23c0b1590 con 0x7fd23c0b3650 2024-03-08T21:33:24.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.657+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6fa49417-d2de-4f3a-be3c-0f49df1ef4ab", "id": 2} v 0) v1 -- 0x7fd23c067db0 con 0x7fd23c0b3650 2024-03-08T21:33:24.649 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.661+0000 7fd232000640 1 -- 172.21.15.160:0/3746099988 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fa49417-d2de-4f3a-be3c-0f49df1ef4ab", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd22c0a8050 con 0x7fd23c0b3650 2024-03-08T21:33:24.649 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 msgr2=0x7fd23c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0ad040 tx=0x7fd22c01ac30 comp rx=0 tx=0).stop 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 shutdown_connections 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd23c14aed0 0x7fd23c14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd23c0b43c0 0x7fd23c1df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 --2- 172.21.15.160:0/3746099988 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd23c0b3650 0x7fd23c0b0cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 >> 172.21.15.160:0/3746099988 conn(0x7fd23c06b5d0 msgr2=0x7fd23c147270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 shutdown_connections 2024-03-08T21:33:24.651 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.665+0000 7fd241200640 1 -- 172.21.15.160:0/3746099988 wait complete. 2024-03-08T21:33:24.669 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new ab7243ce-9ded-4db5-9b08-8378e2558ad9 3 2024-03-08T21:33:24.803 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 Processor -- start 2024-03-08T21:33:24.803 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 -- start start 2024-03-08T21:33:24.804 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19e80b5040 0x7f19e80b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.804 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.804 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e814ac80 con 0x7f19e806db10 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e814b290 con 0x7f19e80b5040 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19ee400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80adfc0 con 0x7f19e8146fe0 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40842/0 (socket says 172.21.15.160:40842) 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 -- 172.21.15.160:0/2254237250 learned_addr learned my addr 172.21.15.160:0/2254237250 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7400640 1 --2- 172.21.15.160:0/2254237250 >> v2:172.21.15.119:3300/0 conn(0x7f19e80b5040 0x7f19e80b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 -- 172.21.15.160:0/2254237250 >> v2:172.21.15.119:3300/0 conn(0x7f19e80b5040 msgr2=0x7f19e80b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 --2- 172.21.15.160:0/2254237250 >> v2:172.21.15.119:3300/0 conn(0x7f19e80b5040 0x7f19e80b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 -- 172.21.15.160:0/2254237250 >> v1:172.21.15.119:6789/0 conn(0x7f19e806db10 legacy=0x7f19e806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.805 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.817+0000 7f19e7e00640 1 -- 172.21.15.160:0/2254237250 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e814af20 con 0x7f19e8146fe0 2024-03-08T21:33:24.807 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19e7e00640 1 --2- 172.21.15.160:0/2254237250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e814b410 tx=0x7f19e001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93065806bee36961 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.807 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19e6000640 1 -- 172.21.15.160:0/2254237250 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a5640 con 0x7f19e8146fe0 2024-03-08T21:33:24.807 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19e6000640 1 -- 172.21.15.160:0/2254237250 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00a57e0 con 0x7f19e8146fe0 2024-03-08T21:33:24.807 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19e6000640 1 -- 172.21.15.160:0/2254237250 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a5bb0 con 0x7f19e8146fe0 2024-03-08T21:33:24.808 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- 172.21.15.160:0/2254237250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 msgr2=0x7f19e8147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.808 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 --2- 172.21.15.160:0/2254237250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19e814b410 tx=0x7f19e001c980 comp rx=0 tx=0).stop 2024-03-08T21:33:24.808 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- 172.21.15.160:0/2254237250 shutdown_connections 2024-03-08T21:33:24.808 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 --2- 172.21.15.160:0/2254237250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e8147430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 --2- 172.21.15.160:0/2254237250 >> v2:172.21.15.119:3300/0 conn(0x7f19e80b5040 0x7f19e80b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- 172.21.15.160:0/2254237250 >> 172.21.15.160:0/2254237250 conn(0x7f19e806b5d0 msgr2=0x7f19e80ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- 172.21.15.160:0/2254237250 shutdown_connections 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- 172.21.15.160:0/2254237250 wait complete. 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 Processor -- start 2024-03-08T21:33:24.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.821+0000 7f19ee400640 1 -- start start 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 0x7f19e80ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19e80b5040 0x7f19e80b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e813dce0 con 0x7f19e806db10 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e813db60 con 0x7f19e80b5040 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e813de60 con 0x7f19e8146fe0 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.812 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e6a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19e80b5040 0x7f19e80b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40848/0 (socket says 172.21.15.160:40848) 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 -- 172.21.15.160:0/73535093 learned_addr learned my addr 172.21.15.160:0/73535093 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 0x7f19e80ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 -- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19e80b5040 msgr2=0x7f19e80b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19e80b5040 0x7f19e80b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 -- 172.21.15.160:0/73535093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 msgr2=0x7f19e80ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 0x7f19e80ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 -- 172.21.15.160:0/73535093 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80b00f0 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 0x7f19e80ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19e7e00640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19e00af040 tx=0x7f19e0019720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00bc030 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00b8470 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80afe10 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0009510 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e80aec60 con 0x7f19e8146fe0 2024-03-08T21:33:24.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f19e00bf070 con 0x7f19e8146fe0 2024-03-08T21:33:24.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f19e00c1a80 con 0x7f19e8146fe0 2024-03-08T21:33:24.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.825+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e80af000 con 0x7f19e8146fe0 2024-03-08T21:33:24.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.829+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f19e00c6070 con 0x7f19e8146fe0 2024-03-08T21:33:24.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.909+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ab7243ce-9ded-4db5-9b08-8378e2558ad9", "id": 3} v 0) v1 -- 0x7f19e8067db0 con 0x7f19e8146fe0 2024-03-08T21:33:24.900 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19df400640 1 -- 172.21.15.160:0/73535093 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab7243ce-9ded-4db5-9b08-8378e2558ad9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f19e80b00f0 con 0x7f19e8146fe0 2024-03-08T21:33:24.900 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-03-08T21:33:24.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 msgr2=0x7f19e81e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19e00af040 tx=0x7f19e0019720 comp rx=0 tx=0).stop 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 shutdown_connections 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19e8146fe0 0x7f19e81e3620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19e80b5040 0x7f19e80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 --2- 172.21.15.160:0/73535093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19e806db10 0x7f19e80ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 >> 172.21.15.160:0/73535093 conn(0x7f19e806b5d0 msgr2=0x7f19e8145120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 shutdown_connections 2024-03-08T21:33:24.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:24.913+0000 7f19ee400640 1 -- 172.21.15.160:0/73535093 wait complete. 2024-03-08T21:33:24.920 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c1da51bd-791e-44f5-b4d8-438af8a3e23b 4 2024-03-08T21:33:24.925 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:24.943+0000 7ffa7b414180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T21:33:24.985 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:24.997+0000 7f35f5bfb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T21:33:24.987 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.007+0000 7ffa7b414180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T21:33:25.047 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.067+0000 7ffa7b414180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T21:33:25.049 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.061+0000 7f35f5bfb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T21:33:25.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.065+0000 7f15fa800640 1 Processor -- start 2024-03-08T21:33:25.054 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.065+0000 7f15fa800640 1 -- start start 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15fa800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15fa800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40b54b0 con 0x7f15f4145910 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15fa800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40b47a0 con 0x7f15f40b43c0 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15fa800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40b2bb0 con 0x7f15f40b3650 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f3400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f15f40b43c0 0x7f15f40b23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:34104/0 (socket says 172.21.15.160:34104) 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f3400640 1 -- 172.21.15.160:0/564844826 learned_addr learned my addr 172.21.15.160:0/564844826 (peer_addr_for_me v1:172.21.15.160:0/0) 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40852/0 (socket says 172.21.15.160:40852) 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2a00640 1 -- 172.21.15.160:0/564844826 >> v1:172.21.15.160:6789/0 conn(0x7f15f40b43c0 legacy=0x7f15f40b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2a00640 1 -- 172.21.15.160:0/564844826 >> v1:172.21.15.119:6789/0 conn(0x7f15f4145910 legacy=0x7f15f414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.056 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2a00640 1 -- 172.21.15.160:0/564844826 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40b2e90 con 0x7f15f40b3650 2024-03-08T21:33:25.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.069+0000 7f15f2000640 1 -- 172.21.15.160:0/564844826 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558876255 0 0) 0x7f15f40b47a0 con 0x7f15f40b43c0 2024-03-08T21:33:25.059 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15f2a00640 1 --2- 172.21.15.160:0/564844826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15e00097f0 tx=0x7f15e001ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58c734059972027 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.059 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15f2000640 1 -- 172.21.15.160:0/564844826 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00a7070 con 0x7f15f40b3650 2024-03-08T21:33:25.059 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15f2000640 1 -- 172.21.15.160:0/564844826 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00b0070 con 0x7f15f40b3650 2024-03-08T21:33:25.059 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15f2000640 1 -- 172.21.15.160:0/564844826 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00ab890 con 0x7f15f40b3650 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- 172.21.15.160:0/564844826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 msgr2=0x7f15f41453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 --2- 172.21.15.160:0/564844826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15e00097f0 tx=0x7f15e001ceb0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- 172.21.15.160:0/564844826 shutdown_connections 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 --2- 172.21.15.160:0/564844826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b3650 0x7f15f41453d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- 172.21.15.160:0/564844826 >> 172.21.15.160:0/564844826 conn(0x7f15f406b5d0 msgr2=0x7f15f40ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- 172.21.15.160:0/564844826 shutdown_connections 2024-03-08T21:33:25.060 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- 172.21.15.160:0/564844826 wait complete. 2024-03-08T21:33:25.061 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 Processor -- start 2024-03-08T21:33:25.061 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- start start 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 0x7f15f4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f4145910 0x7f15f4138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4146100 con 0x7f15f4145910 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4071950 con 0x7f15f40b3650 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.073+0000 7f15fa800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40b3b00 con 0x7f15f40b43c0 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 0x7f15f4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.063 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 0x7f15f4143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53238/0 (socket says 172.21.15.160:53238) 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40868/0 (socket says 172.21.15.160:40868) 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f3400640 1 -- 172.21.15.160:0/4116851342 learned_addr learned my addr 172.21.15.160:0/4116851342 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f3e00640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f4145910 0x7f15f4138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 -- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 msgr2=0x7f15f4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 0x7f15f4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 -- 172.21.15.160:0/4116851342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f4145910 msgr2=0x7f15f4138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f4145910 0x7f15f4138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 -- 172.21.15.160:0/4116851342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f413b230 con 0x7f15f40b43c0 2024-03-08T21:33:25.064 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15f2a00640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15e00ac000 tx=0x7f15f40b6620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.065 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00abe60 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00b4800 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f413bf80 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00b4bf0 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f413dd50 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f15e00c57d0 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f15e00b4d90 con 0x7f15f40b43c0 2024-03-08T21:33:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.077+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f4067db0 con 0x7f15f40b43c0 2024-03-08T21:33:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.081+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f15e00dbe50 con 0x7f15f40b43c0 2024-03-08T21:33:25.113 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.125+0000 7f35f5bfb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T21:33:25.133 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.145+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1da51bd-791e-44f5-b4d8-438af8a3e23b", "id": 4} v 0) v1 -- 0x7f15f406e070 con 0x7f15f40b43c0 2024-03-08T21:33:25.137 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.155+0000 7ffa7b414180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T21:33:25.139 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15eb400640 1 -- 172.21.15.160:0/4116851342 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1da51bd-791e-44f5-b4d8-438af8a3e23b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15e00ca020 con 0x7f15f40b43c0 2024-03-08T21:33:25.139 INFO:teuthology.orchestra.run.smithi160.stdout:4 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 msgr2=0x7f15f413ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15e00ac000 tx=0x7f15f40b6620 comp rx=0 tx=0).stop 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 shutdown_connections 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15f4145910 0x7f15f4138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15f40b43c0 0x7f15f413ce20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 --2- 172.21.15.160:0/4116851342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15f40b3650 0x7f15f4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 >> 172.21.15.160:0/4116851342 conn(0x7f15f406b5d0 msgr2=0x7f15f40ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 shutdown_connections 2024-03-08T21:33:25.141 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.153+0000 7f15fa800640 1 -- 172.21.15.160:0/4116851342 wait complete. 2024-03-08T21:33:25.158 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new a5187b13-fff0-4398-b65d-32bfcbc374d4 5 2024-03-08T21:33:25.196 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.215+0000 7ffa7b414180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T21:33:25.206 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.221+0000 7f35f5bfb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T21:33:25.268 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.281+0000 7f35f5bfb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T21:33:25.284 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.303+0000 7ffa7b414180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T21:33:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.305+0000 7fa222c00640 1 Processor -- start 2024-03-08T21:33:25.294 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.305+0000 7fa222c00640 1 -- start start 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa222c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa21c0b5040 0x7fa21c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa222c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa21c146fe0 0x7fa21c147430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa222c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c14ac80 con 0x7fa21c06db10 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa222c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c14b290 con 0x7fa21c0b5040 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa222c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21c0adfc0 con 0x7fa21c146fe0 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa21c146fe0 0x7fa21c147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa21c146fe0 0x7fa21c147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53254/0 (socket says 172.21.15.160:53254) 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 -- 172.21.15.160:0/426547598 learned_addr learned my addr 172.21.15.160:0/426547598 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa213e00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa21c06db10 0x7fa21c06ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:34116/0 (socket says 172.21.15.160:34116) 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa21be00640 1 --2- 172.21.15.160:0/426547598 >> v2:172.21.15.119:3300/0 conn(0x7fa21c0b5040 0x7fa21c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 -- 172.21.15.160:0/426547598 >> v2:172.21.15.119:3300/0 conn(0x7fa21c0b5040 msgr2=0x7fa21c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 --2- 172.21.15.160:0/426547598 >> v2:172.21.15.119:3300/0 conn(0x7fa21c0b5040 0x7fa21c0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 -- 172.21.15.160:0/426547598 >> v1:172.21.15.160:6789/0 conn(0x7fa21c06db10 legacy=0x7fa21c06ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.297 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.309+0000 7fa220c00640 1 -- 172.21.15.160:0/426547598 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c14af20 con 0x7fa21c146fe0 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa220c00640 1 --2- 172.21.15.160:0/426547598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c147430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa21c14b410 tx=0x7fa21401c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a46f12aa5eab18ff server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa21b400640 1 -- 172.21.15.160:0/426547598 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140a5620 con 0x7fa21c146fe0 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa21b400640 1 -- 172.21.15.160:0/426547598 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140a57c0 con 0x7fa21c146fe0 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa21b400640 1 -- 172.21.15.160:0/426547598 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140a5b90 con 0x7fa21c146fe0 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- 172.21.15.160:0/426547598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 msgr2=0x7fa21c147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- 172.21.15.160:0/426547598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c147430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa21c14b410 tx=0x7fa21401c960 comp rx=0 tx=0).stop 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- 172.21.15.160:0/426547598 shutdown_connections 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- 172.21.15.160:0/426547598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c147430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- 172.21.15.160:0/426547598 >> v2:172.21.15.119:3300/0 conn(0x7fa21c0b5040 0x7fa21c0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.300 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- 172.21.15.160:0/426547598 >> 172.21.15.160:0/426547598 conn(0x7fa21c06b5d0 msgr2=0x7fa21c0ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.301 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- 172.21.15.160:0/426547598 shutdown_connections 2024-03-08T21:33:25.301 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- 172.21.15.160:0/426547598 wait complete. 2024-03-08T21:33:25.301 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 Processor -- start 2024-03-08T21:33:25.301 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- start start 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21c0b5040 0x7fa21c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c13dce0 con 0x7fa21c0b5040 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c13db60 con 0x7fa21c146fe0 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.313+0000 7fa222c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c13de60 con 0x7fa21c06db10 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa21be00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa21be00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40880/0 (socket says 172.21.15.160:40880) 2024-03-08T21:33:25.304 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53262/0 (socket says 172.21.15.160:53262) 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa21be00640 1 -- 172.21.15.160:0/1374030910 learned_addr learned my addr 172.21.15.160:0/1374030910 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa213e00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21c0b5040 0x7fa21c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 -- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 msgr2=0x7fa21c1e37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 -- 172.21.15.160:0/1374030910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21c0b5040 msgr2=0x7fa21c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21c0b5040 0x7fa21c0b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 -- 172.21.15.160:0/1374030910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0af4b0 con 0x7fa21c146fe0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa21be00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa220c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ab000 tx=0x7fa214019700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2140bc030 con 0x7fa21c146fe0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2140b8470 con 0x7fa21c146fe0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c1e2fb0 con 0x7fa21c146fe0 2024-03-08T21:33:25.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa214009510 con 0x7fa21c146fe0 2024-03-08T21:33:25.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c1e2c80 con 0x7fa21c146fe0 2024-03-08T21:33:25.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa2140bf070 con 0x7fa21c146fe0 2024-03-08T21:33:25.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa2140a5720 con 0x7fa21c146fe0 2024-03-08T21:33:25.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.317+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c067db0 con 0x7fa21c146fe0 2024-03-08T21:33:25.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.321+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa2140c7020 con 0x7fa21c146fe0 2024-03-08T21:33:25.347 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.367+0000 7ffa7b414180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T21:33:25.361 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.373+0000 7f35f5bfb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T21:33:25.375 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.389+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a5187b13-fff0-4398-b65d-32bfcbc374d4", "id": 5} v 0) v1 -- 0x7fa21c0b8700 con 0x7fa21c146fe0 2024-03-08T21:33:25.380 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa218c00640 1 -- 172.21.15.160:0/1374030910 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5187b13-fff0-4398-b65d-32bfcbc374d4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2140165e0 con 0x7fa21c146fe0 2024-03-08T21:33:25.380 INFO:teuthology.orchestra.run.smithi160.stdout:5 2024-03-08T21:33:25.381 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 msgr2=0x7fa21c0b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2140ab000 tx=0x7fa214019700 comp rx=0 tx=0).stop 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 shutdown_connections 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21c146fe0 0x7fa21c0b4280 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21c0b5040 0x7fa21c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 --2- 172.21.15.160:0/1374030910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa21c06db10 0x7fa21c1e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 >> 172.21.15.160:0/1374030910 conn(0x7fa21c06b5d0 msgr2=0x7fa21c0ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 shutdown_connections 2024-03-08T21:33:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.393+0000 7fa222c00640 1 -- 172.21.15.160:0/1374030910 wait complete. 2024-03-08T21:33:25.399 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new be79ccf5-b97f-4367-bbb6-2b44e4753d34 6 2024-03-08T21:33:25.431 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.445+0000 7f35f5bfb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T21:33:25.512 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.531+0000 7ffa7b414180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T21:33:25.534 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 Processor -- start 2024-03-08T21:33:25.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 -- start start 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad4071e50 con 0x7f3ad406b6f0 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad406aef0 con 0x7f3ad40728b0 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3adba00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad406b1d0 con 0x7f3ad406eaf0 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:40892/0 (socket says 172.21.15.160:40892) 2024-03-08T21:33:25.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 -- 172.21.15.160:0/1547810412 learned_addr learned my addr 172.21.15.160:0/1547810412 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 -- 172.21.15.160:0/1547810412 >> v1:172.21.15.160:6789/0 conn(0x7f3ad40728b0 legacy=0x7f3ad40b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 -- 172.21.15.160:0/1547810412 >> v1:172.21.15.119:6789/0 conn(0x7f3ad406b6f0 legacy=0x7f3ad4151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3400640 1 -- 172.21.15.160:0/1547810412 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709112874 0 0) 0x7f3ad406aef0 con 0x7f3ad40728b0 2024-03-08T21:33:25.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.549+0000 7f3ad3e00640 1 -- 172.21.15.160:0/1547810412 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad4071a00 con 0x7f3ad406eaf0 2024-03-08T21:33:25.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3ad3e00640 1 --2- 172.21.15.160:0/1547810412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bccce97f6ed36c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3ad3400640 1 -- 172.21.15.160:0/1547810412 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00b0070 con 0x7f3ad406eaf0 2024-03-08T21:33:25.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3ad3400640 1 -- 172.21.15.160:0/1547810412 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac00ab600 con 0x7f3ad406eaf0 2024-03-08T21:33:25.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3ad3400640 1 -- 172.21.15.160:0/1547810412 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00ab9d0 con 0x7f3ad406eaf0 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- 172.21.15.160:0/1547810412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 msgr2=0x7f3ad4072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 --2- 172.21.15.160:0/1547810412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac001c4f0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- 172.21.15.160:0/1547810412 shutdown_connections 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 --2- 172.21.15.160:0/1547810412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad406eaf0 0x7f3ad4072c90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- 172.21.15.160:0/1547810412 >> 172.21.15.160:0/1547810412 conn(0x7f3ad40b6130 msgr2=0x7f3ad40b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- 172.21.15.160:0/1547810412 shutdown_connections 2024-03-08T21:33:25.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- 172.21.15.160:0/1547810412 wait complete. 2024-03-08T21:33:25.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 Processor -- start 2024-03-08T21:33:25.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.553+0000 7f3adba00640 1 -- start start 2024-03-08T21:33:25.544 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad406b6f0 0x7f3ad409d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.544 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.544 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 0x7f3ad409acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.544 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4155ce0 con 0x7f3ad406b6f0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4155b60 con 0x7f3ad406eaf0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4155e60 con 0x7f3ad40728b0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53278/0 (socket says 172.21.15.160:53278) 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 -- 172.21.15.160:0/2960503454 learned_addr learned my addr 172.21.15.160:0/2960503454 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad9000640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad406b6f0 0x7f3ad409d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad9a00640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 0x7f3ad409acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 -- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 msgr2=0x7f3ad409acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 0x7f3ad409acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 -- 172.21.15.160:0/2960503454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad406b6f0 msgr2=0x7f3ad409d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad406b6f0 0x7f3ad409d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 -- 172.21.15.160:0/2960503454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad409e590 con 0x7f3ad406eaf0 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad9a00640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 0x7f3ad409acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:25.545 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad3e00640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac0019290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00b0040 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac00aa950 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 -- 172.21.15.160:0/2960503454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad409e870 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00aad20 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3adba00640 1 -- 172.21.15.160:0/2960503454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad409e220 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3ac00b4420 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3ac00bdcc0 con 0x7f3ad406eaf0 2024-03-08T21:33:25.546 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.557+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad4067db0 con 0x7f3ad406eaf0 2024-03-08T21:33:25.547 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.561+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3ac0016170 con 0x7f3ad406eaf0 2024-03-08T21:33:25.584 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:25.603+0000 7ffa7b414180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T21:33:25.601 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.613+0000 7f35f5bfb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T21:33:25.613 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.625+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be79ccf5-b97f-4367-bbb6-2b44e4753d34", "id": 6} v 0) v1 -- 0x7f3ad40b7680 con 0x7f3ad406eaf0 2024-03-08T21:33:25.618 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ad0c00640 1 -- 172.21.15.160:0/2960503454 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be79ccf5-b97f-4367-bbb6-2b44e4753d34", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ac00bd6d0 con 0x7f3ad406eaf0 2024-03-08T21:33:25.619 INFO:teuthology.orchestra.run.smithi160.stdout:6 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 msgr2=0x7f3ad409a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098a0 tx=0x7f3ac0019290 comp rx=0 tx=0).stop 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 shutdown_connections 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ad40728b0 0x7f3ad409acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ad406eaf0 0x7f3ad409a770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 --2- 172.21.15.160:0/2960503454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ad406b6f0 0x7f3ad409d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 >> 172.21.15.160:0/2960503454 conn(0x7f3ad40b6130 msgr2=0x7f3ad40b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 shutdown_connections 2024-03-08T21:33:25.620 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.633+0000 7f3ac6000640 1 -- 172.21.15.160:0/2960503454 wait complete. 2024-03-08T21:33:25.638 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0 7 2024-03-08T21:33:25.675 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:25.689+0000 7f35f5bfb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T21:33:25.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 Processor -- start 2024-03-08T21:33:25.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 -- start start 2024-03-08T21:33:25.810 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5140b43c0 0x7fe5140b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe514148cf0 0x7fe51414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5140b54b0 con 0x7fe5140b3650 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5140b2900 con 0x7fe5140b43c0 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe51b600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5140b47a0 con 0x7fe514148cf0 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.821+0000 7fe519600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe514148cf0 0x7fe51414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe514148cf0 0x7fe51414fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53282/0 (socket says 172.21.15.160:53282) 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 -- 172.21.15.160:0/603529177 learned_addr learned my addr 172.21.15.160:0/603529177 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe518c00640 1 --2- 172.21.15.160:0/603529177 >> v2:172.21.15.119:3300/0 conn(0x7fe5140b43c0 0x7fe5140b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 -- 172.21.15.160:0/603529177 >> v2:172.21.15.119:3300/0 conn(0x7fe5140b43c0 msgr2=0x7fe5140b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 --2- 172.21.15.160:0/603529177 >> v2:172.21.15.119:3300/0 conn(0x7fe5140b43c0 0x7fe5140b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 -- 172.21.15.160:0/603529177 >> v1:172.21.15.119:6789/0 conn(0x7fe5140b3650 legacy=0x7fe5141485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.811 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 -- 172.21.15.160:0/603529177 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140b2bb0 con 0x7fe514148cf0 2024-03-08T21:33:25.813 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe519600640 1 --2- 172.21.15.160:0/603529177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514148cf0 0x7fe51414fb90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5140b2ae0 tx=0x7fe50c01d2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebba9d092250c389 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe513400640 1 -- 172.21.15.160:0/603529177 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0a5760 con 0x7fe514148cf0 2024-03-08T21:33:25.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe513400640 1 -- 172.21.15.160:0/603529177 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0a5900 con 0x7fe514148cf0 2024-03-08T21:33:25.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.825+0000 7fe513400640 1 -- 172.21.15.160:0/603529177 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0a5cd0 con 0x7fe514148cf0 2024-03-08T21:33:25.814 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/603529177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514148cf0 msgr2=0x7fe51414fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- 172.21.15.160:0/603529177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514148cf0 0x7fe51414fb90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe5140b2ae0 tx=0x7fe50c01d2e0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/603529177 shutdown_connections 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- 172.21.15.160:0/603529177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe514148cf0 0x7fe51414fb90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- 172.21.15.160:0/603529177 >> v2:172.21.15.119:3300/0 conn(0x7fe5140b43c0 0x7fe5140b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/603529177 >> 172.21.15.160:0/603529177 conn(0x7fe51406b5d0 msgr2=0x7fe5140ba560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/603529177 shutdown_connections 2024-03-08T21:33:25.815 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/603529177 wait complete. 2024-03-08T21:33:25.816 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 Processor -- start 2024-03-08T21:33:25.816 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- start start 2024-03-08T21:33:25.818 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.818 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5140b43c0 0x7fe51414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.818 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe514148cf0 0x7fe5141e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514071910 con 0x7fe514148cf0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140ae200 con 0x7fe5140b3650 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5141528f0 con 0x7fe5140b43c0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53294/0 (socket says 172.21.15.160:53294) 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 -- 172.21.15.160:0/4068686208 learned_addr learned my addr 172.21.15.160:0/4068686208 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe513e00640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5140b43c0 0x7fe51414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe519600640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe514148cf0 0x7fe5141e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 -- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5140b43c0 msgr2=0x7fe51414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5140b43c0 0x7fe51414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 -- 172.21.15.160:0/4068686208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe514148cf0 msgr2=0x7fe5141e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe514148cf0 0x7fe5141e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 -- 172.21.15.160:0/4068686208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51414b720 con 0x7fe5140b3650 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe518c00640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe50800e930 tx=0x7fe50800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:25.819 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508017070 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50800ca00 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51414b9a0 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.829+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50800cdb0 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.833+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe514149690 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.833+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe50801a070 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.833+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe508006660 con 0x7fe5140b3650 2024-03-08T21:33:25.820 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.833+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe514067db0 con 0x7fe5140b3650 2024-03-08T21:33:25.821 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.833+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fe51414b720 con 0x7fe5140b3650 2024-03-08T21:33:25.887 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.901+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0", "id": 7} v 0) v1 -- 0x7fe514149bb0 con 0x7fe5140b3650 2024-03-08T21:33:25.893 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe510c00640 1 -- 172.21.15.160:0/4068686208 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe5080059a0 con 0x7fe5140b3650 2024-03-08T21:33:25.893 INFO:teuthology.orchestra.run.smithi160.stdout:7 2024-03-08T21:33:25.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 msgr2=0x7fe5140acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe50800e930 tx=0x7fe50800edf0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 shutdown_connections 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe514148cf0 0x7fe5141e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5140b43c0 0x7fe51414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 --2- 172.21.15.160:0/4068686208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5140b3650 0x7fe5140acb20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 >> 172.21.15.160:0/4068686208 conn(0x7fe51406b5d0 msgr2=0x7fe5140b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.905+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 shutdown_connections 2024-03-08T21:33:25.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-03-08T21:33:25.909+0000 7fe51b600640 1 -- 172.21.15.160:0/4068686208 wait complete. 2024-03-08T21:33:25.911 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-08T21:33:25.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-08T21:33:25.916 INFO:tasks.ceph.osd.0:Started 2024-03-08T21:33:25.916 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-08T21:33:25.916 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-08T21:33:25.927 INFO:tasks.ceph.osd.1:Started 2024-03-08T21:33:25.927 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-08T21:33:25.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-08T21:33:25.932 INFO:tasks.ceph.osd.2:Started 2024-03-08T21:33:25.932 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-08T21:33:25.932 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-08T21:33:25.942 INFO:tasks.ceph.osd.3:Started 2024-03-08T21:33:25.942 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-08T21:33:25.943 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-08T21:33:25.946 INFO:tasks.ceph.osd.4:Started 2024-03-08T21:33:25.946 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-08T21:33:25.946 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-08T21:33:25.949 INFO:tasks.ceph.osd.5:Started 2024-03-08T21:33:25.949 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-08T21:33:25.949 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-08T21:33:25.952 INFO:tasks.ceph.osd.6:Started 2024-03-08T21:33:25.952 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-08T21:33:25.952 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-08T21:33:25.957 INFO:tasks.ceph.osd.7:Started 2024-03-08T21:33:25.957 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:26.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.150+0000 7f2af0800640 1 Processor -- start 2024-03-08T21:33:26.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.150+0000 7f2af0800640 1 -- start start 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2af0800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2ae80b8c30 0x7f2ae814a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2af0800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae8072110 con 0x7f2ae814adc0 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2af0800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae80715b0 con 0x7f2ae8071d30 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2af0800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80732e0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aed400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2ae80b8c30 0x7f2ae814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:26.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aee800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2ae814adc0 0x7f2ae8151b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50132/0 (socket says 172.21.15.119:50132) 2024-03-08T21:33:26.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aee800640 1 -- 172.21.15.119:0/2761590094 learned_addr learned my addr 172.21.15.119:0/2761590094 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:26.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aed400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2ae80b8c30 0x7f2ae814a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60806/0 (socket says 172.21.15.119:60806) 2024-03-08T21:33:26.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aed400640 1 -- 172.21.15.119:0/2761590094 >> v1:172.21.15.160:6789/0 conn(0x7f2ae8071d30 legacy=0x7f2ae806b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aed400640 1 -- 172.21.15.119:0/2761590094 >> v1:172.21.15.119:6789/0 conn(0x7f2ae814adc0 legacy=0x7f2ae8151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.154+0000 7f2aed400640 1 -- 172.21.15.119:0/2761590094 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80723d0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aed400640 1 --2- 172.21.15.119:0/2761590094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae814a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8073460 tx=0x7f2ad801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d75ec8c5c60f69 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:26.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aeca00640 1 -- 172.21.15.119:0/2761590094 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80b1070 con 0x7f2ae80b8c30 2024-03-08T21:33:26.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aeca00640 1 -- 172.21.15.119:0/2761590094 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80ac600 con 0x7f2ae80b8c30 2024-03-08T21:33:26.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aeca00640 1 -- 172.21.15.119:0/2761590094 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80ac9d0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- 172.21.15.119:0/2761590094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 msgr2=0x7f2ae814a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 --2- 172.21.15.119:0/2761590094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae814a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8073460 tx=0x7f2ad801c380 comp rx=0 tx=0).stop 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- 172.21.15.119:0/2761590094 shutdown_connections 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 --2- 172.21.15.119:0/2761590094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae814a880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- 172.21.15.119:0/2761590094 >> 172.21.15.119:0/2761590094 conn(0x7f2ae80b94a0 msgr2=0x7f2ae80b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- 172.21.15.119:0/2761590094 shutdown_connections 2024-03-08T21:33:26.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- 172.21.15.119:0/2761590094 wait complete. 2024-03-08T21:33:26.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 Processor -- start 2024-03-08T21:33:26.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- start start 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ae8071d30 0x7f2ae813cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ae814adc0 0x7f2ae8146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80b90e0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae806bba0 con 0x7f2ae814adc0 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2af0800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80b9260 con 0x7f2ae8071d30 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aed400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:26.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aed400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60822/0 (socket says 172.21.15.119:60822) 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.158+0000 7f2aed400640 1 -- 172.21.15.119:0/362941027 learned_addr learned my addr 172.21.15.119:0/362941027 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 -- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ae8071d30 msgr2=0x7f2ae813cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ae8071d30 0x7f2ae813cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 -- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ae814adc0 msgr2=0x7f2ae8146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ae814adc0 0x7f2ae8146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 -- 172.21.15.119:0/362941027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae81e0620 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2aed400640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8019fb0 tx=0x7f2ad801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80b1040 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80bd070 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80b7880 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae81e08c0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8147f30 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2ad80ac4c0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2ad80b7db0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.162+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8067db0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.166+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2ad80c6020 con 0x7f2ae80b8c30 2024-03-08T21:33:26.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ae81492e0 con 0x7f2ae80b8c30 2024-03-08T21:33:26.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2ae2000640 1 -- 172.21.15.119:0/362941027 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f2ad8016090 con 0x7f2ae80b8c30 2024-03-08T21:33:26.205 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:26.205 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":10,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:25.908447+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:26.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 msgr2=0x7f2ae813d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:26.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8019fb0 tx=0x7f2ad801abc0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 shutdown_connections 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ae814adc0 0x7f2ae8146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ae80b8c30 0x7f2ae813d140 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 --2- 172.21.15.119:0/362941027 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ae8071d30 0x7f2ae813cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 >> 172.21.15.119:0/362941027 conn(0x7f2ae80b94a0 msgr2=0x7f2ae806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 shutdown_connections 2024-03-08T21:33:26.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:26.222+0000 7f2af0800640 1 -- 172.21.15.119:0/362941027 wait complete. 2024-03-08T21:33:26.225 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-08T21:33:26.225 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-08T21:33:26.239 INFO:tasks.ceph.mgr.y.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-08T21:33:26.239 INFO:tasks.ceph.mgr.y.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-08T21:33:26.239 INFO:tasks.ceph.mgr.y.smithi119.stderr: from numpy import show_config as show_numpy_config 2024-03-08T21:33:26.279 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:26.294+0000 7ffa7b414180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T21:33:26.380 INFO:tasks.ceph.mgr.x.smithi160.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-08T21:33:26.380 INFO:tasks.ceph.mgr.x.smithi160.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-08T21:33:26.380 INFO:tasks.ceph.mgr.x.smithi160.stderr: from numpy import show_config as show_numpy_config 2024-03-08T21:33:26.429 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:26.446+0000 7ffa7b414180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T21:33:26.440 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:26.453+0000 7f35f5bfb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T21:33:26.586 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:26.597+0000 7f35f5bfb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T21:33:26.588 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-03-08T21:33:26.606+0000 7f15cfa2c7c0 -1 Falling back to public interface 2024-03-08T21:33:26.601 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:26.618+0000 7ffa7b414180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T21:33:26.603 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-03-08T21:33:26.617+0000 7fb7f82a07c0 -1 Falling back to public interface 2024-03-08T21:33:26.619 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-03-08T21:33:26.633+0000 7fad52e597c0 -1 Falling back to public interface 2024-03-08T21:33:26.624 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-03-08T21:33:26.642+0000 7fb3eb0b27c0 -1 Falling back to public interface 2024-03-08T21:33:26.636 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-03-08T21:33:26.654+0000 7f24b622b7c0 -1 Falling back to public interface 2024-03-08T21:33:26.644 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-03-08T21:33:26.657+0000 7f7ad6e2b7c0 -1 Falling back to public interface 2024-03-08T21:33:26.660 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-03-08T21:33:26.678+0000 7f3426c7e7c0 -1 Falling back to public interface 2024-03-08T21:33:26.663 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-03-08T21:33:26.677+0000 7f2f42e2b7c0 -1 Falling back to public interface 2024-03-08T21:33:26.677 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:26.694+0000 7ffa7b414180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T21:33:26.773 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:26.785+0000 7f35f5bfb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T21:33:26.825 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:26.842+0000 7ffa7b414180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T21:33:26.844 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:26.857+0000 7f35f5bfb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T21:33:26.994 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:27.005+0000 7f35f5bfb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T21:33:27.031 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:27.156 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 Processor -- start 2024-03-08T21:33:27.156 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 -- start start 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 0x7f873c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f873c14d630 0x7f873c14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c0726a0 con 0x7f873c06cdb0 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0b5060 con 0x7f873c14d630 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8743800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c0b52b0 con 0x7f873c071d00 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f873c14d630 0x7f873c14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f873c14d630 0x7f873c14fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60824/0 (socket says 172.21.15.119:60824) 2024-03-08T21:33:27.159 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 -- 172.21.15.119:0/3764892652 learned_addr learned my addr 172.21.15.119:0/3764892652 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f873be00640 1 --2- 172.21.15.119:0/3764892652 >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 0x7f873c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 -- 172.21.15.119:0/3764892652 >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 msgr2=0x7f873c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 --2- 172.21.15.119:0/3764892652 >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 0x7f873c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 -- 172.21.15.119:0/3764892652 >> v1:172.21.15.119:6789/0 conn(0x7f873c06cdb0 legacy=0x7f873c141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f8741800640 1 -- 172.21.15.119:0/3764892652 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c06d190 con 0x7f873c14d630 2024-03-08T21:33:27.160 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.174+0000 7f873be00640 1 --2- 172.21.15.119:0/3764892652 >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 0x7f873c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:27.162 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8741800640 1 --2- 172.21.15.119:0/3764892652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c14fa20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b3100 tx=0x7f873401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a850e4710c4a9581 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:27.162 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f873b400640 1 -- 172.21.15.119:0/3764892652 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340a5760 con 0x7f873c14d630 2024-03-08T21:33:27.162 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f873b400640 1 -- 172.21.15.119:0/3764892652 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340a5900 con 0x7f873c14d630 2024-03-08T21:33:27.162 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f873b400640 1 -- 172.21.15.119:0/3764892652 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340a5cd0 con 0x7f873c14d630 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 -- 172.21.15.119:0/3764892652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 msgr2=0x7f873c14fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 --2- 172.21.15.119:0/3764892652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c14fa20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b3100 tx=0x7f873401c8a0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 -- 172.21.15.119:0/3764892652 shutdown_connections 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 --2- 172.21.15.119:0/3764892652 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c14fa20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 --2- 172.21.15.119:0/3764892652 >> v2:172.21.15.160:3300/0 conn(0x7f873c071d00 0x7f873c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 -- 172.21.15.119:0/3764892652 >> 172.21.15.119:0/3764892652 conn(0x7f873c06af10 msgr2=0x7f873c06b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:27.163 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 -- 172.21.15.119:0/3764892652 shutdown_connections 2024-03-08T21:33:27.164 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.178+0000 7f8743800640 1 -- 172.21.15.119:0/3764892652 wait complete. 2024-03-08T21:33:27.165 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 Processor -- start 2024-03-08T21:33:27.165 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 -- start start 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f873c06cdb0 0x7f873c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f873c071d00 0x7f873c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c070cf0 con 0x7f873c14d630 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c071080 con 0x7f873c06cdb0 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8743800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c144050 con 0x7f873c071d00 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60836/0 (socket says 172.21.15.119:60836) 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 -- 172.21.15.119:0/690956780 learned_addr learned my addr 172.21.15.119:0/690956780 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:27.168 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8740e00640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f873c06cdb0 0x7f873c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f873be00640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f873c071d00 0x7f873c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 -- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f873c071d00 msgr2=0x7f873c144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f873c071d00 0x7f873c144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.182+0000 7f8741800640 1 -- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f873c06cdb0 msgr2=0x7f873c140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8741800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f873c06cdb0 0x7f873c140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8741800640 1 -- 172.21.15.119:0/690956780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c144910 con 0x7f873c14d630 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8741800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87340af040 tx=0x7f8734019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340bc020 con 0x7f873c14d630 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87340b8690 con 0x7f873c14d630 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c1442c0 con 0x7f873c14d630 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340b8a80 con 0x7f873c14d630 2024-03-08T21:33:27.169 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c142ef0 con 0x7f873c14d630 2024-03-08T21:33:27.170 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f87340bf020 con 0x7f873c14d630 2024-03-08T21:33:27.170 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f87340c1ad0 con 0x7f873c14d630 2024-03-08T21:33:27.170 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.186+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c075090 con 0x7f873c14d630 2024-03-08T21:33:27.171 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.190+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f87340c6030 con 0x7f873c14d630 2024-03-08T21:33:27.228 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f873c06fd90 con 0x7f873c14d630 2024-03-08T21:33:27.228 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8738c00640 1 -- 172.21.15.119:0/690956780 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f87340165e0 con 0x7f873c14d630 2024-03-08T21:33:27.229 INFO:teuthology.misc.health.smithi119.stdout: 2024-03-08T21:33:27.229 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":10,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:25.908447+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 msgr2=0x7f873c145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f87340af040 tx=0x7f8734019640 comp rx=0 tx=0).stop 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 shutdown_connections 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f873c14d630 0x7f873c145330 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f873c071d00 0x7f873c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 --2- 172.21.15.119:0/690956780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f873c06cdb0 0x7f873c140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 >> 172.21.15.119:0/690956780 conn(0x7f873c06af10 msgr2=0x7f873c0b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 shutdown_connections 2024-03-08T21:33:27.230 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:27.246+0000 7f8743800640 1 -- 172.21.15.119:0/690956780 wait complete. 2024-03-08T21:33:27.247 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-08T21:33:27.535 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:27.550+0000 7ffa7b414180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T21:33:27.622 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:27.638+0000 7ffa7b414180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T21:33:27.671 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:27.685+0000 7f35f5bfb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T21:33:27.762 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:27.773+0000 7f35f5bfb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T21:33:27.822 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:27.838+0000 7ffa7b414180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T21:33:27.908 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:27.926+0000 7ffa7b414180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T21:33:27.963 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:27.977+0000 7f35f5bfb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T21:33:28.046 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:28.061+0000 7f35f5bfb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T21:33:28.308 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:28.326+0000 7ffa7b414180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T21:33:28.374 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:28.389+0000 7f35f5bfb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T21:33:28.379 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:28.394+0000 7ffa7b414180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T21:33:28.451 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-03-08T21:33:28.465+0000 7f35f5bfb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T21:33:29.402 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:29.418+0000 7ffa21400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-08T21:33:29.403 INFO:tasks.ceph.mgr.y.smithi119.stderr:2024-03-08T21:33:29.418+0000 7ffa21400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-08T21:33:30.389 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-03-08T21:33:30.406+0000 7f15cfa2c7c0 -1 osd.0 0 log_to_monitors true 2024-03-08T21:33:30.409 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-03-08T21:33:30.421+0000 7fb7f82a07c0 -1 osd.4 0 log_to_monitors true 2024-03-08T21:33:30.501 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-03-08T21:33:30.513+0000 7f7ad6e2b7c0 -1 osd.5 0 log_to_monitors true 2024-03-08T21:33:30.515 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-03-08T21:33:30.529+0000 7fad52e597c0 -1 osd.7 0 log_to_monitors true 2024-03-08T21:33:30.528 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-03-08T21:33:30.546+0000 7fb3eb0b27c0 -1 osd.1 0 log_to_monitors true 2024-03-08T21:33:30.534 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-03-08T21:33:30.550+0000 7f24b622b7c0 -1 osd.3 0 log_to_monitors true 2024-03-08T21:33:30.619 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-03-08T21:33:30.633+0000 7f2f42e2b7c0 -1 osd.6 0 log_to_monitors true 2024-03-08T21:33:30.632 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-03-08T21:33:30.650+0000 7f3426c7e7c0 -1 osd.2 0 log_to_monitors true 2024-03-08T21:33:32.434 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-03-08T21:33:32.449+0000 7f15c9400640 -1 osd.0 0 waiting for initial osdmap 2024-03-08T21:33:32.467 INFO:tasks.ceph.osd.0.smithi119.stderr:2024-03-08T21:33:32.481+0000 7f15bfe00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:32.521 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-03-08T21:33:32.532+0000 7fb7f2800640 -1 osd.4 0 waiting for initial osdmap 2024-03-08T21:33:32.594 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-03-08T21:33:32.604+0000 7fb7e9200640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.054 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:34.203 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-03-08T21:33:34.212+0000 7f2f3e600640 -1 osd.6 0 waiting for initial osdmap 2024-03-08T21:33:34.230 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-03-08T21:33:34.240+0000 7f2f33200640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.236 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-03-08T21:33:34.248+0000 7fad4d400640 -1 osd.7 0 waiting for initial osdmap 2024-03-08T21:33:34.242 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-03-08T21:33:34.257+0000 7f24afc00640 -1 osd.3 0 waiting for initial osdmap 2024-03-08T21:33:34.245 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 Processor -- start 2024-03-08T21:33:34.245 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 -- start start 2024-03-08T21:33:34.246 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f60e014f580 0x7f60e0144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.246 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0145480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.246 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e01459c0 con 0x7f60e014ea90 2024-03-08T21:33:34.246 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e006d890 con 0x7f60e014f580 2024-03-08T21:33:34.246 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60e5200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e006be50 con 0x7f60e00b4200 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60dde00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f60e014ea90 0x7f60e014ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33146/0 (socket says 172.21.15.119:33146) 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60dde00640 1 -- 172.21.15.119:0/3022145242 learned_addr learned my addr 172.21.15.119:0/3022145242 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60dd400640 1 --2- 172.21.15.119:0/3022145242 >> v2:172.21.15.160:3300/0 conn(0x7f60e014f580 0x7f60e0144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60de800640 1 --2- 172.21.15.119:0/3022145242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60de800640 1 -- 172.21.15.119:0/3022145242 >> v2:172.21.15.160:3300/0 conn(0x7f60e014f580 msgr2=0x7f60e0144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60de800640 1 --2- 172.21.15.119:0/3022145242 >> v2:172.21.15.160:3300/0 conn(0x7f60e014f580 0x7f60e0144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.247 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60de800640 1 -- 172.21.15.119:0/3022145242 >> v1:172.21.15.119:6789/0 conn(0x7f60e014ea90 legacy=0x7f60e014ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.248 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.261+0000 7f60de800640 1 -- 172.21.15.119:0/3022145242 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e006dac0 con 0x7f60e00b4200 2024-03-08T21:33:34.248 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-03-08T21:33:34.260+0000 7f7ad0800640 -1 osd.5 0 waiting for initial osdmap 2024-03-08T21:33:34.250 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60de800640 1 --2- 172.21.15.119:0/3022145242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0145480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009d90 tx=0x7f60d801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb05a9c455866383 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:34.251 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60dca00640 1 -- 172.21.15.119:0/3022145242 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80b2070 con 0x7f60e00b4200 2024-03-08T21:33:34.251 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60dca00640 1 -- 172.21.15.119:0/3022145242 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d80a5a30 con 0x7f60e00b4200 2024-03-08T21:33:34.251 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60dca00640 1 -- 172.21.15.119:0/3022145242 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80a5e00 con 0x7f60e00b4200 2024-03-08T21:33:34.252 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60e5200640 1 -- 172.21.15.119:0/3022145242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 msgr2=0x7f60e0145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.252 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.265+0000 7f60e5200640 1 --2- 172.21.15.119:0/3022145242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0145480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009d90 tx=0x7f60d801c970 comp rx=0 tx=0).stop 2024-03-08T21:33:34.252 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.269+0000 7f60e5200640 1 -- 172.21.15.119:0/3022145242 shutdown_connections 2024-03-08T21:33:34.252 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.269+0000 7f60e5200640 1 --2- 172.21.15.119:0/3022145242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0145480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.252 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.269+0000 7f60e5200640 1 --2- 172.21.15.119:0/3022145242 >> v2:172.21.15.160:3300/0 conn(0x7f60e014f580 0x7f60e0144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.253 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.269+0000 7f60e5200640 1 -- 172.21.15.119:0/3022145242 >> 172.21.15.119:0/3022145242 conn(0x7f60e00ba680 msgr2=0x7f60e00baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:34.256 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- 172.21.15.119:0/3022145242 shutdown_connections 2024-03-08T21:33:34.256 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- 172.21.15.119:0/3022145242 wait complete. 2024-03-08T21:33:34.259 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 Processor -- start 2024-03-08T21:33:34.259 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- start start 2024-03-08T21:33:34.260 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e014ea90 0x7f60e00b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e014f580 0x7f60e013cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0158560 con 0x7f60e014f580 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01583e0 con 0x7f60e014ea90 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.273+0000 7f60e5200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01586e0 con 0x7f60e00b4200 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:38100/0 (socket says 172.21.15.119:38100) 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dd400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e014ea90 0x7f60e00b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 -- 172.21.15.119:0/1552893009 learned_addr learned my addr 172.21.15.119:0/1552893009 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:34.261 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60de800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e014f580 0x7f60e013cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 -- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e014ea90 msgr2=0x7f60e00b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e014ea90 0x7f60e00b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 -- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e014f580 msgr2=0x7f60e013cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e014f580 0x7f60e013cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 -- 172.21.15.119:0/1552893009 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00b2060 con 0x7f60e00b4200 2024-03-08T21:33:34.262 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60dde00640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c450 tx=0x7f60d000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:34.263 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0017070 con 0x7f60e00b4200 2024-03-08T21:33:34.263 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e01494c0 con 0x7f60e00b4200 2024-03-08T21:33:34.263 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e013e330 con 0x7f60e00b4200 2024-03-08T21:33:34.263 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0005cf0 con 0x7f60e00b4200 2024-03-08T21:33:34.263 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.277+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0017070 con 0x7f60e00b4200 2024-03-08T21:33:34.264 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.281+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b80052a0 con 0x7f60e00b4200 2024-03-08T21:33:34.266 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.281+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 4) v1 ==== 87027+0+0 (secure 0 0 0) 0x7f60d001a070 con 0x7f60e00b4200 2024-03-08T21:33:34.267 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.281+0000 7f60d6000640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 0x7f60c0069c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:34.268 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-03-08T21:33:34.280+0000 7fad43e00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.268 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.281+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2791+0+0 (secure 0 0 0) 0x7f60d0083a00 con 0x7f60e00b4200 2024-03-08T21:33:34.268 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.281+0000 7f60dd400640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 0x7f60c0069c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:34.269 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.285+0000 7f60dd400640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 0x7f60c0069c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b8b40 tx=0x7f60cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:34.272 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.289+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f60d0054c60 con 0x7f60e00b4200 2024-03-08T21:33:34.273 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-03-08T21:33:34.289+0000 7fb3e7400640 -1 osd.1 0 waiting for initial osdmap 2024-03-08T21:33:34.290 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-03-08T21:33:34.305+0000 7f24a6600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.298 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-03-08T21:33:34.308+0000 7f7ac7200640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.313 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-03-08T21:33:34.329+0000 7f3423000640 -1 osd.2 0 waiting for initial osdmap 2024-03-08T21:33:34.322 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-03-08T21:33:34.337+0000 7fb3dc000640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.346 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-03-08T21:33:34.361+0000 7f3417c00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T21:33:34.442 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.457+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b8005590 con 0x7f60e00b4200 2024-03-08T21:33:34.442 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.457+0000 7f60d6000640 1 -- 172.21.15.119:0/1552893009 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8041 (secure 0 0 0) 0x7f60d0058d00 con 0x7f60e00b4200 2024-03-08T21:33:34.443 INFO:teuthology.misc.health.smithi119.stdout: 2024-03-08T21:33:34.443 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":14,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:33.480737+0000","last_up_change":"2024-03-08T21:33:33.480737+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 msgr2=0x7f60c0069c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 0x7f60c0069c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b8b40 tx=0x7f60cc009190 comp rx=0 tx=0).stop 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 msgr2=0x7f60e0141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c450 tx=0x7f60d000c910 comp rx=0 tx=0).stop 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 shutdown_connections 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f60c00677d0 0x7f60c0069c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60e014f580 0x7f60e013cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e014ea90 0x7f60e00b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.446 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 --2- 172.21.15.119:0/1552893009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60e00b4200 0x7f60e0141c80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:34.446 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 >> 172.21.15.119:0/1552893009 conn(0x7f60e00ba680 msgr2=0x7f60e014e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:34.446 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 shutdown_connections 2024-03-08T21:33:34.446 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:34.461+0000 7f60e5200640 1 -- 172.21.15.119:0/1552893009 wait complete. 2024-03-08T21:33:34.464 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-03-08T21:33:41.271 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:41.407 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 Processor -- start 2024-03-08T21:33:41.407 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 -- start start 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f36040b46e0 0x7f36041504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36040b55e0 con 0x7f36040b4300 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36040b3970 con 0x7f36040b5990 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3608e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36040b5ee0 con 0x7f36040b46e0 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3603400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f36040b4300 0x7f36040b3260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33156/0 (socket says 172.21.15.119:33156) 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3603400640 1 -- 172.21.15.119:0/1842869243 learned_addr learned my addr 172.21.15.119:0/1842869243 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3603e00640 1 --2- 172.21.15.119:0/1842869243 >> v2:172.21.15.160:3300/0 conn(0x7f36040b46e0 0x7f36041504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521572593 0 0) 0x7f36040b55e0 con 0x7f36040b4300 2024-03-08T21:33:41.409 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.420+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e8003530 con 0x7f36040b4300 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698055778 0 0) 0x7f35e8003530 con 0x7f36040b4300 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 >> v2:172.21.15.160:3300/0 conn(0x7f36040b46e0 msgr2=0x7f36041504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 --2- 172.21.15.119:0/1842869243 >> v2:172.21.15.160:3300/0 conn(0x7f36040b46e0 0x7f36041504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 >> v1:172.21.15.160:6789/0 conn(0x7f36040b5990 legacy=0x7f360413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040b4ea0 con 0x7f36040b4300 2024-03-08T21:33:41.411 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f35f4001680 con 0x7f36040b4300 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 >> v1:172.21.15.119:6789/0 conn(0x7f36040b4300 legacy=0x7f36040b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80039c0 0x7f35e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35e8004810 0x7f35e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 0x7f35e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e800c040 con 0x7f35e80051d0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e800c1f0 con 0x7f35e80039c0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e800c3f0 con 0x7f35e8004810 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 0x7f35e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603400640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80039c0 0x7f35e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602a00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35e8004810 0x7f35e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 -- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35e8004810 msgr2=0x7f35e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35e8004810 0x7f35e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 -- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80039c0 msgr2=0x7f35e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80039c0 0x7f35e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 -- 172.21.15.119:0/1842869243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8003530 con 0x7f35e80051d0 2024-03-08T21:33:41.412 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3602a00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35e8004810 0x7f35e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:41.413 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 -- 172.21.15.119:0/1842869243 reap_dead start 2024-03-08T21:33:41.413 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.424+0000 7f3603e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 0x7f35e800b9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009fc0 tx=0x7f35fc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4071e410e8a1a6f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.413 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc009c10 con 0x7f35e80051d0 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0a5d10 con 0x7f35e80051d0 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3602000640 1 -- 172.21.15.119:0/1842869243 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc003be0 con 0x7f35e80051d0 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 msgr2=0x7f35e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 0x7f35e800b9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009fc0 tx=0x7f35fc01ccc0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- 172.21.15.119:0/1842869243 shutdown_connections 2024-03-08T21:33:41.414 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 --2- 172.21.15.119:0/1842869243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80051d0 0x7f35e800b9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.415 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- 172.21.15.119:0/1842869243 >> 172.21.15.119:0/1842869243 conn(0x7f36040ba4a0 msgr2=0x7f36040ba8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:41.415 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- 172.21.15.119:0/1842869243 shutdown_connections 2024-03-08T21:33:41.415 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- 172.21.15.119:0/1842869243 wait complete. 2024-03-08T21:33:41.415 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 Processor -- start 2024-03-08T21:33:41.415 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- start start 2024-03-08T21:33:41.417 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80051d0 0x7f36041df7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.417 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36041dfcf0 0x7f360413a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.417 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.417 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36040b6c30 con 0x7f36041e0170 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36040b5390 con 0x7f35e80051d0 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3608e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36040b6db0 con 0x7f36041dfcf0 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3603e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3603e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38990/0 (socket says 172.21.15.119:38990) 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3603e00640 1 -- 172.21.15.119:0/3407412418 learned_addr learned my addr 172.21.15.119:0/3407412418 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3602a00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36041dfcf0 0x7f360413a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.428+0000 7f3603400640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80051d0 0x7f36041df7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 -- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36041dfcf0 msgr2=0x7f360413a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36041dfcf0 0x7f360413a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 -- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80051d0 msgr2=0x7f36041df7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80051d0 0x7f36041df7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 -- 172.21.15.119:0/3407412418 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604142530 con 0x7f36041e0170 2024-03-08T21:33:41.418 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35fc01d1a0 tx=0x7f35fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0aed80 con 0x7f36041e0170 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0bd070 con 0x7f36041e0170 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc003ba0 con 0x7f36041e0170 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3604140450 con 0x7f36041e0170 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36041406f0 con 0x7f36041e0170 2024-03-08T21:33:41.419 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3604075090 con 0x7f36041e0170 2024-03-08T21:33:41.420 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f35fc0a5d10 con 0x7f36041e0170 2024-03-08T21:33:41.420 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 0x7f35e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.420 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35fc120ce0 con 0x7f36041e0170 2024-03-08T21:33:41.421 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.432+0000 7f3603400640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 0x7f35e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.421 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.436+0000 7f3603400640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 0x7f35e4069b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f35f4001ce0 tx=0x7f35f4001c70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.445 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.460+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f35fc0c7020 con 0x7f36041e0170 2024-03-08T21:33:41.600 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.612+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f360413dc10 con 0x7f36041e0170 2024-03-08T21:33:41.601 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.612+0000 7f35fb400640 1 -- 172.21.15.119:0/3407412418 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12908 (secure 0 0 0) 0x7f35fc0169d0 con 0x7f36041e0170 2024-03-08T21:33:41.601 INFO:teuthology.misc.health.smithi119.stdout: 2024-03-08T21:33:41.601 INFO:teuthology.misc.health.smithi119.stdout:{"epoch":17,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:37.235138+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 msgr2=0x7f35e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 0x7f35e4069b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f35f4001ce0 tx=0x7f35f4001c70 comp rx=0 tx=0).stop 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 msgr2=0x7f360413ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f35fc01d1a0 tx=0x7f35fc009750 comp rx=0 tx=0).stop 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 shutdown_connections 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f35e4067690 0x7f35e4069b50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36041e0170 0x7f360413ac00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.603 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36041dfcf0 0x7f360413a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.604 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 --2- 172.21.15.119:0/3407412418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35e80051d0 0x7f36041df7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.604 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 >> 172.21.15.119:0/3407412418 conn(0x7f36040ba4a0 msgr2=0x7f360413e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:41.604 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 shutdown_connections 2024-03-08T21:33:41.604 INFO:teuthology.misc.health.smithi119.stderr:2024-03-08T21:33:41.616+0000 7f3608e00640 1 -- 172.21.15.119:0/3407412418 wait complete. 2024-03-08T21:33:41.619 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-08T21:33:41.619 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-08T21:33:41.620 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-08T21:33:41.620 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-08T21:33:41.623 INFO:tasks.ceph.mds.a:Started 2024-03-08T21:33:41.623 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-08T21:33:41.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-08T21:33:41.626 INFO:tasks.ceph.mds.b:Started 2024-03-08T21:33:41.626 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-08T21:33:41.626 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:41.725 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-03-08T21:33:41.743 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-03-08T21:33:41.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 Processor -- start 2024-03-08T21:33:41.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 -- start start 2024-03-08T21:33:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 0x7f9ffc09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc072fe0 0x7f9ffc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc09b190 con 0x7f9ffc072fe0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc09d240 con 0x7f9ffc1446e0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa002c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc09d520 con 0x7f9ffc09adb0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ffbe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 0x7f9ffc09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc072fe0 0x7f9ffc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa000c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ffbe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 0x7f9ffc09cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:38172/0 (socket says 172.21.15.119:38172) 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa000c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:45320/0 (socket says 172.21.15.119:45320) 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa000c00640 1 -- 172.21.15.119:0/1449267753 learned_addr learned my addr 172.21.15.119:0/1449267753 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ffc072fe0 0x7f9ffc1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39010/0 (socket says 172.21.15.119:39010) 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 -- 172.21.15.119:0/1449267753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 msgr2=0x7f9ffc09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 --2- 172.21.15.119:0/1449267753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 0x7f9ffc09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 -- 172.21.15.119:0/1449267753 >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 msgr2=0x7f9ffc13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 --2- 172.21.15.119:0/1449267753 >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7f9ff3400640 1 -- 172.21.15.119:0/1449267753 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc144af0 con 0x7f9ffc072fe0 2024-03-08T21:33:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.780+0000 7fa000c00640 1 --2- 172.21.15.119:0/1449267753 >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:41.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7f9ff3400640 1 --2- 172.21.15.119:0/1449267753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc1441a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc141840 tx=0x7f9fe401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddedde10df695eb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7f9ffb400640 1 -- 172.21.15.119:0/1449267753 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b1070 con 0x7f9ffc072fe0 2024-03-08T21:33:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7f9ffb400640 1 -- 172.21.15.119:0/1449267753 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40ac600 con 0x7f9ffc072fe0 2024-03-08T21:33:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7f9ffb400640 1 -- 172.21.15.119:0/1449267753 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40ac9d0 con 0x7f9ffc072fe0 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 -- 172.21.15.119:0/1449267753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc072fe0 msgr2=0x7f9ffc1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 --2- 172.21.15.119:0/1449267753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc1441a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc141840 tx=0x7f9fe401c420 comp rx=0 tx=0).stop 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 -- 172.21.15.119:0/1449267753 shutdown_connections 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 --2- 172.21.15.119:0/1449267753 >> v2:172.21.15.160:3300/0 conn(0x7f9ffc1446e0 0x7f9ffc13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 --2- 172.21.15.119:0/1449267753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc1441a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 --2- 172.21.15.119:0/1449267753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc09adb0 0x7f9ffc09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 -- 172.21.15.119:0/1449267753 >> 172.21.15.119:0/1449267753 conn(0x7f9ffc06c620 msgr2=0x7f9ffc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 -- 172.21.15.119:0/1449267753 shutdown_connections 2024-03-08T21:33:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 -- 172.21.15.119:0/1449267753 wait complete. 2024-03-08T21:33:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.784+0000 7fa002c00640 1 Processor -- start 2024-03-08T21:33:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- start start 2024-03-08T21:33:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc13a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 0x7f9ffc1376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147bd0 con 0x7f9ffc09adb0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147a50 con 0x7f9ffc072fe0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc147d50 con 0x7f9ffc1446e0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39020/0 (socket says 172.21.15.119:39020) 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 -- 172.21.15.119:0/518503242 learned_addr learned my addr 172.21.15.119:0/518503242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa000c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 0x7f9ffc1376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ffbe00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc13a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 -- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 msgr2=0x7f9ffc1376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 0x7f9ffc1376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 -- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ffc072fe0 msgr2=0x7f9ffc13a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc13a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 -- 172.21.15.119:0/518503242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc145550 con 0x7f9ffc09adb0 2024-03-08T21:33:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa000c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 0x7f9ffc1376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff3400640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe401ab30 tx=0x7f9fe401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40b1040 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40ac400 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc0b7a30 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4006e20 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc13ac60 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc13aea0 con 0x7f9ffc09adb0 2024-03-08T21:33:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.788+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9fe40be030 con 0x7f9ffc09adb0 2024-03-08T21:33:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.792+0000 7f9ff8c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 0x7f9fd8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.792+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9fe411ee60 con 0x7f9ffc09adb0 2024-03-08T21:33:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.792+0000 7f9ffbe00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 0x7f9fd8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.792+0000 7f9ffbe00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 0x7f9fd8069b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009af0 tx=0x7f9fec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:41.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.796+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f9ffc13aea0 con 0x7f9ffc09adb0 2024-03-08T21:33:41.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ffc067db0 con 0x7f9ffc09adb0 2024-03-08T21:33:41.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7f9ff8c00640 1 -- 172.21.15.119:0/518503242 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12908 (secure 0 0 0) 0x7f9fe40c5060 con 0x7f9ffc09adb0 2024-03-08T21:33:41.938 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:41.939 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:37.235138+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 msgr2=0x7f9fd8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 0x7f9fd8069b20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009af0 tx=0x7f9fec008040 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 msgr2=0x7f9ffc1df6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9fe401ab30 tx=0x7f9fe401acc0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 shutdown_connections 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9fd8067660 0x7f9fd8069b20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ffc1446e0 0x7f9ffc1376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ffc09adb0 0x7f9ffc1df6f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 --2- 172.21.15.119:0/518503242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ffc072fe0 0x7f9ffc13a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 >> 172.21.15.119:0/518503242 conn(0x7f9ffc06c620 msgr2=0x7f9ffc06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 shutdown_connections 2024-03-08T21:33:41.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:41.952+0000 7fa002c00640 1 -- 172.21.15.119:0/518503242 wait complete. 2024-03-08T21:33:41.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:33:41.959 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:33:42.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.108+0000 7f5444a00640 1 Processor -- start 2024-03-08T21:33:42.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.108+0000 7f5444a00640 1 -- start start 2024-03-08T21:33:42.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.108+0000 7f5444a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5444a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f5440147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5444a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54400b4a50 con 0x7f5440147570 2024-03-08T21:33:42.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5444a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54400ae9d0 con 0x7f54400ad600 2024-03-08T21:33:42.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5444a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54400b4d90 con 0x7f5440072cb0 2024-03-08T21:33:42.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543e800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5437e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f5440147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543e800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:45328/0 (socket says 172.21.15.119:45328) 2024-03-08T21:33:42.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543e800640 1 -- 172.21.15.119:0/619564686 learned_addr learned my addr 172.21.15.119:0/619564686 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543f200640 1 --1- 172.21.15.119:0/619564686 >> v1:172.21.15.160:6789/0 conn(0x7f5440147570 0x7f5440143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:51086/0 (socket says 172.21.15.119:51086) 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5437e00640 1 -- 172.21.15.119:0/619564686 >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 msgr2=0x7f54400b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5437e00640 1 --2- 172.21.15.119:0/619564686 >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5437e00640 1 -- 172.21.15.119:0/619564686 >> v1:172.21.15.160:6789/0 conn(0x7f5440147570 legacy=0x7f5440143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f5437e00640 1 -- 172.21.15.119:0/619564686 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400ad9e0 con 0x7f5440072cb0 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543e800640 1 --2- 172.21.15.119:0/619564686 >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:42.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.112+0000 7f543de00640 1 -- 172.21.15.119:0/619564686 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992904607 0 0) 0x7f54400b4a50 con 0x7f5440147570 2024-03-08T21:33:42.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5437e00640 1 --2- 172.21.15.119:0/619564686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f5440147030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54280097c0 tx=0x7f542801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ce91e3e260f1a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543de00640 1 -- 172.21.15.119:0/619564686 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280b0070 con 0x7f5440072cb0 2024-03-08T21:33:42.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543de00640 1 -- 172.21.15.119:0/619564686 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54280ab600 con 0x7f5440072cb0 2024-03-08T21:33:42.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543de00640 1 -- 172.21.15.119:0/619564686 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280ab9d0 con 0x7f5440072cb0 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- 172.21.15.119:0/619564686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 msgr2=0x7f5440147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- 172.21.15.119:0/619564686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f5440147030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54280097c0 tx=0x7f542801c410 comp rx=0 tx=0).stop 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- 172.21.15.119:0/619564686 shutdown_connections 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- 172.21.15.119:0/619564686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f5440147030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- 172.21.15.119:0/619564686 >> v2:172.21.15.160:3300/0 conn(0x7f54400ad600 0x7f54400b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- 172.21.15.119:0/619564686 >> 172.21.15.119:0/619564686 conn(0x7f54400b8380 msgr2=0x7f54400b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:42.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- 172.21.15.119:0/619564686 shutdown_connections 2024-03-08T21:33:42.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- 172.21.15.119:0/619564686 wait complete. 2024-03-08T21:33:42.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 Processor -- start 2024-03-08T21:33:42.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- start start 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f544014e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54400ad600 0x7f544014ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400b4800 con 0x7f54401e34a0 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400b4680 con 0x7f54400ad600 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5444a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544006c450 con 0x7f5440072cb0 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543f200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543f200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39032/0 (socket says 172.21.15.119:39032) 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543f200640 1 -- 172.21.15.119:0/1400293900 learned_addr learned my addr 172.21.15.119:0/1400293900 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:42.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f543e800640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f544014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.116+0000 7f5437e00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54400ad600 0x7f544014ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 -- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 msgr2=0x7f544014e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f544014e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 -- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54400ad600 msgr2=0x7f544014ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54400ad600 0x7f544014ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 -- 172.21.15.119:0/1400293900 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54401e3e70 con 0x7f54401e34a0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543e800640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f544014e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f543f200640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f543800cb20 tx=0x7f54380020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800a6e0 con 0x7f54401e34a0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800a880 con 0x7f54401e34a0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800ac70 con 0x7f54401e34a0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54400b0400 con 0x7f54401e34a0 2024-03-08T21:33:42.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544014dae0 con 0x7f54401e34a0 2024-03-08T21:33:42.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440067db0 con 0x7f54401e34a0 2024-03-08T21:33:42.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5438006070 con 0x7f54401e34a0 2024-03-08T21:33:42.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.120+0000 7f5436a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 0x7f541c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.124+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54380854f0 con 0x7f54401e34a0 2024-03-08T21:33:42.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.124+0000 7f543e800640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 0x7f541c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.124+0000 7f543e800640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 0x7f541c069b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5430009630 tx=0x7f5430009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.128+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f5438055e80 con 0x7f54401e34a0 2024-03-08T21:33:42.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54400b4460 con 0x7f54401e34a0 2024-03-08T21:33:42.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5436a00640 1 -- 172.21.15.119:0/1400293900 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5438059f20 con 0x7f54401e34a0 2024-03-08T21:33:42.270 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 msgr2=0x7f541c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 0x7f541c069b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5430009630 tx=0x7f5430009240 comp rx=0 tx=0).stop 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 msgr2=0x7f54401e3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f543800cb20 tx=0x7f54380020c0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 shutdown_connections 2024-03-08T21:33:42.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f541c067660 0x7f541c069b20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54401e34a0 0x7f54401e3930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54400ad600 0x7f544014ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 --2- 172.21.15.119:0/1400293900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5440072cb0 0x7f544014e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 >> 172.21.15.119:0/1400293900 conn(0x7f54400b8380 msgr2=0x7f544009a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 shutdown_connections 2024-03-08T21:33:42.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.284+0000 7f5444a00640 1 -- 172.21.15.119:0/1400293900 wait complete. 2024-03-08T21:33:42.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:33:42.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 Processor -- start 2024-03-08T21:33:42.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 -- start start 2024-03-08T21:33:42.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 0x7fe72413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe72409a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe72409ae10 0x7fe7240b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.436+0000 7fe72ae00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7240b4b60 con 0x7fe72409ae10 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe72ae00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72409a080 con 0x7fe724099ca0 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe72ae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b4510 con 0x7fe72413f2c0 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe72409ae10 0x7fe7240b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe72409ae10 0x7fe7240b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39036/0 (socket says 172.21.15.119:39036) 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 -- 172.21.15.119:0/821637397 learned_addr learned my addr 172.21.15.119:0/821637397 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe723400640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe72409a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 -- 172.21.15.119:0/821637397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 msgr2=0x7fe72409a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe723e00640 1 --2- 172.21.15.119:0/821637397 >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 0x7fe72413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe72409a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 -- 172.21.15.119:0/821637397 >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 msgr2=0x7fe72413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:42.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 --2- 172.21.15.119:0/821637397 >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 0x7fe72413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 -- 172.21.15.119:0/821637397 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240b47f0 con 0x7fe72409ae10 2024-03-08T21:33:42.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe723400640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe72409a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:42.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe723e00640 1 --2- 172.21.15.119:0/821637397 >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 0x7fe72413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:42.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe728e00640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7240b1d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe72406e100 tx=0x7fe71c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fea0b917d953c22 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe722a00640 1 -- 172.21.15.119:0/821637397 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0ab5f0 con 0x7fe72409ae10 2024-03-08T21:33:42.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe722a00640 1 -- 172.21.15.119:0/821637397 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c0b0070 con 0x7fe72409ae10 2024-03-08T21:33:42.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.440+0000 7fe722a00640 1 -- 172.21.15.119:0/821637397 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0ab9b0 con 0x7fe72409ae10 2024-03-08T21:33:42.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- 172.21.15.119:0/821637397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 msgr2=0x7fe7240b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7240b1d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe72406e100 tx=0x7fe71c01c520 comp rx=0 tx=0).stop 2024-03-08T21:33:42.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- 172.21.15.119:0/821637397 shutdown_connections 2024-03-08T21:33:42.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7240b1d30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- 172.21.15.119:0/821637397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe72409a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- 172.21.15.119:0/821637397 >> v2:172.21.15.160:3300/0 conn(0x7fe724099ca0 0x7fe72413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- 172.21.15.119:0/821637397 >> 172.21.15.119:0/821637397 conn(0x7fe72406c620 msgr2=0x7fe72406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- 172.21.15.119:0/821637397 shutdown_connections 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- 172.21.15.119:0/821637397 wait complete. 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 Processor -- start 2024-03-08T21:33:42.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- start start 2024-03-08T21:33:42.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe724099ca0 0x7fe7241e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe7241ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b5b50 con 0x7fe72409ae10 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b59d0 con 0x7fe724099ca0 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe72ae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b5cd0 con 0x7fe72413f2c0 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:39042/0 (socket says 172.21.15.119:39042) 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 -- 172.21.15.119:0/2337925208 learned_addr learned my addr 172.21.15.119:0/2337925208 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723e00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe724099ca0 0x7fe7241e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe728e00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe7241ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 -- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 msgr2=0x7fe7241ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe7241ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 -- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe724099ca0 msgr2=0x7fe7241e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe724099ca0 0x7fe7241e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.444+0000 7fe723400640 1 -- 172.21.15.119:0/2337925208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724141ef0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe723400640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c7f0 tx=0x7fe71000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710007a30 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe710007bd0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7241421d0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100113f0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7241e16c0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe724067db0 con 0x7fe72409ae10 2024-03-08T21:33:42.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe710011590 con 0x7fe72409ae10 2024-03-08T21:33:42.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 0x7fe704069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:42.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7100856e0 con 0x7fe72409ae10 2024-03-08T21:33:42.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe723e00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 0x7fe704069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:42.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.448+0000 7fe723e00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 0x7fe704069b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe714007510 tx=0x7fe7140074a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:42.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.452+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fe710015020 con 0x7fe72409ae10 2024-03-08T21:33:42.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.640+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7241e1bb0 con 0x7fe72409ae10 2024-03-08T21:33:42.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.640+0000 7fe71be00640 1 -- 172.21.15.119:0/2337925208 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fe7100566a0 con 0x7fe72409ae10 2024-03-08T21:33:42.628 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:42.628 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-08T21:33:42.628 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 2 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 msgr2=0x7fe704069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 0x7fe704069b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe714007510 tx=0x7fe7140074a0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 msgr2=0x7fe7241dd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe71000c7f0 tx=0x7fe71000ccb0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 shutdown_connections 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe704067690 0x7fe704069b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe72413f2c0 0x7fe7241ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe72409ae10 0x7fe7241dd7c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 --2- 172.21.15.119:0/2337925208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe724099ca0 0x7fe7241e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 >> 172.21.15.119:0/2337925208 conn(0x7fe72406c620 msgr2=0x7fe724073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:42.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 shutdown_connections 2024-03-08T21:33:42.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:42.644+0000 7fe72ae00640 1 -- 172.21.15.119:0/2337925208 wait complete. 2024-03-08T21:33:44.649 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:33:44.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 Processor -- start 2024-03-08T21:33:44.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 -- start start 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2f40b4410 0x7ff2f40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40b2be0 con 0x7ff2f413f2b0 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40b5fb0 con 0x7ff2f40b47f0 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fc200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40b5970 con 0x7ff2f40b4410 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2f9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2f40b4410 0x7ff2f40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:44.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fa200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff2f413f2b0 0x7ff2f414f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58716/0 (socket says 172.21.15.119:58716) 2024-03-08T21:33:44.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2fa200640 1 -- 172.21.15.119:0/2162414740 learned_addr learned my addr 172.21.15.119:0/2162414740 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:44.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2f9800640 1 -- 172.21.15.119:0/2162414740 >> v1:172.21.15.160:6789/0 conn(0x7ff2f40b47f0 legacy=0x7ff2f413eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:44.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2f9800640 1 -- 172.21.15.119:0/2162414740 >> v1:172.21.15.119:6789/0 conn(0x7ff2f413f2b0 legacy=0x7ff2f414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2f9800640 1 -- 172.21.15.119:0/2162414740 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40b5600 con 0x7ff2f40b4410 2024-03-08T21:33:44.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.808+0000 7ff2f3e00640 1 -- 172.21.15.119:0/2162414740 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442893444 0 0) 0x7ff2f40b2be0 con 0x7ff2f413f2b0 2024-03-08T21:33:44.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2f9800640 1 --2- 172.21.15.119:0/2162414740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b4410 0x7ff2f40b32e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80097c0 tx=0x7ff2e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862c0ecf5469e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:44.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2f3e00640 1 -- 172.21.15.119:0/2162414740 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80b0070 con 0x7ff2f40b4410 2024-03-08T21:33:44.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2f3e00640 1 -- 172.21.15.119:0/2162414740 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e80ab600 con 0x7ff2f40b4410 2024-03-08T21:33:44.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2f3e00640 1 -- 172.21.15.119:0/2162414740 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80ab9d0 con 0x7ff2f40b4410 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- 172.21.15.119:0/2162414740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b4410 msgr2=0x7ff2f40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2162414740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b4410 0x7ff2f40b32e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80097c0 tx=0x7ff2e801c460 comp rx=0 tx=0).stop 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- 172.21.15.119:0/2162414740 shutdown_connections 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2162414740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b4410 0x7ff2f40b32e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- 172.21.15.119:0/2162414740 >> 172.21.15.119:0/2162414740 conn(0x7ff2f406b6e0 msgr2=0x7ff2f40ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- 172.21.15.119:0/2162414740 shutdown_connections 2024-03-08T21:33:44.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- 172.21.15.119:0/2162414740 wait complete. 2024-03-08T21:33:44.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 Processor -- start 2024-03-08T21:33:44.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.812+0000 7ff2fc200640 1 -- start start 2024-03-08T21:33:44.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f40b4410 0x7ff2f4136280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 0x7ff2f406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f41537a0 con 0x7ff2f40b47f0 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4153920 con 0x7ff2f40b4410 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4153aa0 con 0x7ff2f413f2b0 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40398/0 (socket says 172.21.15.119:40398) 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 -- 172.21.15.119:0/2296522533 learned_addr learned my addr 172.21.15.119:0/2296522533 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fa200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 0x7ff2f406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f9800640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f40b4410 0x7ff2f4136280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 -- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 msgr2=0x7ff2f406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 0x7ff2f406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 -- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f40b4410 msgr2=0x7ff2f4136280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f40b4410 0x7ff2f4136280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 -- 172.21.15.119:0/2296522533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f41358c0 con 0x7ff2f40b47f0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fa200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 0x7ff2f406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f8e00640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c480 tx=0x7ff2e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0012830 con 0x7ff2f40b47f0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0017070 con 0x7ff2f40b47f0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f413fdd0 con 0x7ff2f40b47f0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0012c30 con 0x7ff2f40b47f0 2024-03-08T21:33:44.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f40b1570 con 0x7ff2f40b47f0 2024-03-08T21:33:44.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4067db0 con 0x7ff2f40b47f0 2024-03-08T21:33:44.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.816+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff2e001c460 con 0x7ff2f40b47f0 2024-03-08T21:33:44.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.820+0000 7ff2f1600640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 0x7ff2d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:44.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.820+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2e0085220 con 0x7ff2f40b47f0 2024-03-08T21:33:44.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.820+0000 7ff2f9800640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 0x7ff2d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:44.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.820+0000 7ff2f9800640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 0x7ff2d4069b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80ad000 tx=0x7ff2e80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:44.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:44.824+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff2e0056280 con 0x7ff2f40b47f0 2024-03-08T21:33:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2f406e070 con 0x7ff2f40b47f0 2024-03-08T21:33:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2f1600640 1 -- 172.21.15.119:0/2296522533 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2120 (secure 0 0 0) 0x7ff2e0055b80 con 0x7ff2f40b47f0 2024-03-08T21:33:44.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:44.996 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-08T21:33:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 3 2024-03-08T21:33:44.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 msgr2=0x7ff2d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 0x7ff2d4069b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80ad000 tx=0x7ff2e80a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 msgr2=0x7ff2f406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c480 tx=0x7ff2e000c940 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 shutdown_connections 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff2d4067660 0x7ff2d4069b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2f413f2b0 0x7ff2f406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2f40b47f0 0x7ff2f406cc70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 --2- 172.21.15.119:0/2296522533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f40b4410 0x7ff2f4136280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.008+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 >> 172.21.15.119:0/2296522533 conn(0x7ff2f406b6e0 msgr2=0x7ff2f4144e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.012+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 shutdown_connections 2024-03-08T21:33:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.012+0000 7ff2fc200640 1 -- 172.21.15.119:0/2296522533 wait complete. 2024-03-08T21:33:45.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 Processor -- start 2024-03-08T21:33:45.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 -- start start 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f43bc09adb0 0x7f43bc09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43bc072fe0 0x7f43bc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc144b30 con 0x7f43bc1446e0 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc09b190 con 0x7f43bc072fe0 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43c0a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc09d240 con 0x7f43bc09adb0 2024-03-08T21:33:45.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43bc072fe0 0x7f43bc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43bc072fe0 0x7f43bc1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40414/0 (socket says 172.21.15.119:40414) 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 -- 172.21.15.119:0/254451973 learned_addr learned my addr 172.21.15.119:0/254451973 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43ba800640 1 --1- 172.21.15.119:0/254451973 >> v1:172.21.15.119:6789/0 conn(0x7f43bc1446e0 0x7f43bc13d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58720/0 (socket says 172.21.15.119:58720) 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b9e00640 1 --2- 172.21.15.119:0/254451973 >> v2:172.21.15.160:3300/0 conn(0x7f43bc09adb0 0x7f43bc09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 -- 172.21.15.119:0/254451973 >> v2:172.21.15.160:3300/0 conn(0x7f43bc09adb0 msgr2=0x7f43bc09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 --2- 172.21.15.119:0/254451973 >> v2:172.21.15.160:3300/0 conn(0x7f43bc09adb0 0x7f43bc09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 -- 172.21.15.119:0/254451973 >> v1:172.21.15.119:6789/0 conn(0x7f43bc1446e0 legacy=0x7f43bc13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.164+0000 7f43b1400640 1 -- 172.21.15.119:0/254451973 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc09d520 con 0x7f43bc072fe0 2024-03-08T21:33:45.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43b1400640 1 --2- 172.21.15.119:0/254451973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc072fe0 0x7f43bc1441a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06f120 tx=0x7f43a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96967cd6898e4de server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43b9400640 1 -- 172.21.15.119:0/254451973 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40ab650 con 0x7f43bc072fe0 2024-03-08T21:33:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43b9400640 1 -- 172.21.15.119:0/254451973 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40b0070 con 0x7f43bc072fe0 2024-03-08T21:33:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43b9400640 1 -- 172.21.15.119:0/254451973 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40aba10 con 0x7f43bc072fe0 2024-03-08T21:33:45.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 -- 172.21.15.119:0/254451973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc072fe0 msgr2=0x7f43bc1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 --2- 172.21.15.119:0/254451973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc072fe0 0x7f43bc1441a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43bc06f120 tx=0x7f43a401c430 comp rx=0 tx=0).stop 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 -- 172.21.15.119:0/254451973 shutdown_connections 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 --2- 172.21.15.119:0/254451973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc072fe0 0x7f43bc1441a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 --2- 172.21.15.119:0/254451973 >> v2:172.21.15.160:3300/0 conn(0x7f43bc09adb0 0x7f43bc09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 -- 172.21.15.119:0/254451973 >> 172.21.15.119:0/254451973 conn(0x7f43bc06c620 msgr2=0x7f43bc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 -- 172.21.15.119:0/254451973 shutdown_connections 2024-03-08T21:33:45.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.168+0000 7f43c0a00640 1 -- 172.21.15.119:0/254451973 wait complete. 2024-03-08T21:33:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 Processor -- start 2024-03-08T21:33:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- start start 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 0x7f43bc13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43bc1446e0 0x7f43bc134770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc151180 con 0x7f43bc09adb0 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc151000 con 0x7f43bc072fe0 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc151300 con 0x7f43bc1446e0 2024-03-08T21:33:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40430/0 (socket says 172.21.15.119:40430) 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 -- 172.21.15.119:0/1091340377 learned_addr learned my addr 172.21.15.119:0/1091340377 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b9e00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 0x7f43bc13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43ba800640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43bc1446e0 0x7f43bc134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 -- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43bc1446e0 msgr2=0x7f43bc134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43bc1446e0 0x7f43bc134770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 -- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 msgr2=0x7f43bc13b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 0x7f43bc13b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 -- 172.21.15.119:0/1091340377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0b6ea0 con 0x7f43bc09adb0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b9e00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 0x7f43bc13b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b1400640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43a40ad040 tx=0x7f43a401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40be5f0 con 0x7f43bc09adb0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40be790 con 0x7f43bc09adb0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc0b7180 con 0x7f43bc09adb0 2024-03-08T21:33:45.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40beb40 con 0x7f43bc09adb0 2024-03-08T21:33:45.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc0b6320 con 0x7f43bc09adb0 2024-03-08T21:33:45.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.172+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc067db0 con 0x7f43bc09adb0 2024-03-08T21:33:45.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.176+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f43a40b43f0 con 0x7f43bc09adb0 2024-03-08T21:33:45.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.176+0000 7f43b2a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 0x7f4398069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.176+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43a4120340 con 0x7f43bc09adb0 2024-03-08T21:33:45.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.176+0000 7f43b9e00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 0x7f4398069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.176+0000 7f43b9e00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 0x7f4398069b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007a70 tx=0x7f43ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.180+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f43a4016110 con 0x7f43bc09adb0 2024-03-08T21:33:45.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43bc1374a0 con 0x7f43bc09adb0 2024-03-08T21:33:45.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43b2a00640 1 -- 172.21.15.119:0/1091340377 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12908 (secure 0 0 0) 0x7f43a40f1420 con 0x7f43bc09adb0 2024-03-08T21:33:45.328 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:45.328 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:37.235138+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 msgr2=0x7f4398069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 0x7f4398069b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43ac007a70 tx=0x7f43ac008040 comp rx=0 tx=0).stop 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 msgr2=0x7f43bc1e2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.340+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43a40ad040 tx=0x7f43a401acd0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 shutdown_connections 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4398067660 0x7f4398069b20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43bc1446e0 0x7f43bc134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43bc09adb0 0x7f43bc1e2e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 --2- 172.21.15.119:0/1091340377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43bc072fe0 0x7f43bc13b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 >> 172.21.15.119:0/1091340377 conn(0x7f43bc06c620 msgr2=0x7f43bc06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 shutdown_connections 2024-03-08T21:33:45.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.344+0000 7f43c0a00640 1 -- 172.21.15.119:0/1091340377 wait complete. 2024-03-08T21:33:45.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:33:45.348 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:33:45.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 Processor -- start 2024-03-08T21:33:45.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 -- start start 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f414806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f41480b4b30 0x7f414814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4148072270 con 0x7f41480b4710 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480b4fb0 con 0x7f41480b4b30 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414e600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4148072d10 con 0x7f41480b5560 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f41480b4710 0x7f414813eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58726/0 (socket says 172.21.15.119:58726) 2024-03-08T21:33:45.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 -- 172.21.15.119:0/778912182 learned_addr learned my addr 172.21.15.119:0/778912182 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:45.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659432165 0 0) 0x7f4148072270 con 0x7f41480b4710 2024-03-08T21:33:45.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f412c003530 con 0x7f41480b4710 2024-03-08T21:33:45.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414d200640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f414806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414dc00640 1 --2- 172.21.15.119:0/778912182 >> v2:172.21.15.160:3300/0 conn(0x7f41480b4b30 0x7f414814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3560604692 0 0) 0x7f412c003530 con 0x7f41480b4710 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 msgr2=0x7f414806e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f414806e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 >> v2:172.21.15.160:3300/0 conn(0x7f41480b4b30 msgr2=0x7f414814f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 --2- 172.21.15.119:0/778912182 >> v2:172.21.15.160:3300/0 conn(0x7f41480b4b30 0x7f414814f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480b5940 con 0x7f41480b4710 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f4130001680 con 0x7f41480b4710 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 >> v1:172.21.15.119:6789/0 conn(0x7f41480b4710 legacy=0x7f414813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f412c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f412c003f90 0x7f412c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f412c004d50 0x7f412c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480b4fb0 con 0x7f412c003f90 2024-03-08T21:33:45.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c00ba00 con 0x7f412c004d50 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c00bc00 con 0x7f41480b5560 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414dc00640 1 --2- 172.21.15.119:0/778912182 >> v2:172.21.15.160:3300/0 conn(0x7f41480b4b30 0x7f414814f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f412c003f90 0x7f412c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414d200640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f412c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f414dc00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f412c004d50 0x7f412c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 -- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 msgr2=0x7f412c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480b5560 0x7f412c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 -- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f412c004d50 msgr2=0x7f412c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f412c004d50 0x7f412c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.500+0000 7f413fe00640 1 -- 172.21.15.119:0/778912182 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c003530 con 0x7f412c003f90 2024-03-08T21:33:45.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f413fe00640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f412c003f90 0x7f412c004810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f414806f1f0 tx=0x7f413001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d74d2a70e574 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130007c90 con 0x7f412c003f90 2024-03-08T21:33:45.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130005ae0 con 0x7f412c003f90 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f4147e00640 1 -- 172.21.15.119:0/778912182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130007070 con 0x7f412c003f90 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 -- 172.21.15.119:0/778912182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f412c003f90 msgr2=0x7f412c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 --2- 172.21.15.119:0/778912182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f412c003f90 0x7f412c004810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f414806f1f0 tx=0x7f413001f310 comp rx=0 tx=0).stop 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414dc00640 1 -- 172.21.15.119:0/778912182 reap_dead start 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 -- 172.21.15.119:0/778912182 shutdown_connections 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 -- 172.21.15.119:0/778912182 >> 172.21.15.119:0/778912182 conn(0x7f41480b6130 msgr2=0x7f41480b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 -- 172.21.15.119:0/778912182 shutdown_connections 2024-03-08T21:33:45.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.504+0000 7f414e600640 1 -- 172.21.15.119:0/778912182 wait complete. 2024-03-08T21:33:45.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 Processor -- start 2024-03-08T21:33:45.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- start start 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 0x7f414809e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 0x7f41481395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414813f260 con 0x7f4148139b30 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480727f0 con 0x7f414813ba90 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414813f3e0 con 0x7f412c003f90 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40450/0 (socket says 172.21.15.119:40450) 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 -- 172.21.15.119:0/2266449866 learned_addr learned my addr 172.21.15.119:0/2266449866 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f413fe00640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 0x7f41481395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414d200640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 0x7f414809e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 -- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 msgr2=0x7f414809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 0x7f414809e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 -- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 msgr2=0x7f41481395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 0x7f41481395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 -- 172.21.15.119:0/2266449866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414813bf10 con 0x7f4148139b30 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414d200640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 0x7f414809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f413fe00640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 0x7f41481395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414dc00640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41480716d0 tx=0x7f4140010530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140010db0 con 0x7f4148139b30 2024-03-08T21:33:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400039a0 con 0x7f4148139b30 2024-03-08T21:33:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140003b90 con 0x7f4148139b30 2024-03-08T21:33:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4148139fb0 con 0x7f4148139b30 2024-03-08T21:33:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41480997f0 con 0x7f4148139b30 2024-03-08T21:33:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.508+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41480b3ad0 con 0x7f4148139b30 2024-03-08T21:33:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.512+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f414001e030 con 0x7f4148139b30 2024-03-08T21:33:45.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.512+0000 7f4145600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 0x7f4124069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.512+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4140085cd0 con 0x7f4148139b30 2024-03-08T21:33:45.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.512+0000 7f414d200640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 0x7f4124069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.512+0000 7f414d200640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 0x7f4124069b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4138009b00 tx=0x7f4138008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.516+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f4140025020 con 0x7f4148139b30 2024-03-08T21:33:45.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4148067db0 con 0x7f4148139b30 2024-03-08T21:33:45.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f4145600640 1 -- 172.21.15.119:0/2266449866 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4148139fb0 con 0x7f4148139b30 2024-03-08T21:33:45.658 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:33:45.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 msgr2=0x7f4124069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 0x7f4124069b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4138009b00 tx=0x7f4138008040 comp rx=0 tx=0).stop 2024-03-08T21:33:45.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 msgr2=0x7f414813aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f41480716d0 tx=0x7f4140010530 comp rx=0 tx=0).stop 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 shutdown_connections 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4124067690 0x7f4124069b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4148139b30 0x7f414813aa10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414813ba90 0x7f41481395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 --2- 172.21.15.119:0/2266449866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f412c003f90 0x7f414809e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 >> 172.21.15.119:0/2266449866 conn(0x7f41480b6130 msgr2=0x7f414806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 shutdown_connections 2024-03-08T21:33:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.672+0000 7f414e600640 1 -- 172.21.15.119:0/2266449866 wait complete. 2024-03-08T21:33:45.679 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-08T21:33:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.824+0000 7fa7f6e00640 1 Processor -- start 2024-03-08T21:33:45.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.824+0000 7fa7f6e00640 1 -- start start 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.824+0000 7fa7f6e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f009a8d0 0x7fa7f009ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.824+0000 7fa7f6e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7f00b1d30 0x7fa7f00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f6e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f00b26c0 con 0x7fa7f0099ca0 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f6e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f00b4b60 con 0x7fa7f00b1d30 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f6e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f009a080 con 0x7fa7f009a8d0 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7f00b1d30 0x7fa7f00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7f00b1d30 0x7fa7f00b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40452/0 (socket says 172.21.15.119:40452) 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 -- 172.21.15.119:0/906660475 learned_addr learned my addr 172.21.15.119:0/906660475 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7e7400640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f009a8d0 0x7fa7f009ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 -- 172.21.15.119:0/906660475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f009a8d0 msgr2=0x7fa7f009ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f009a8d0 0x7fa7f009ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 -- 172.21.15.119:0/906660475 >> v1:172.21.15.160:6789/0 conn(0x7fa7f0099ca0 legacy=0x7fa7f013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 -- 172.21.15.119:0/906660475 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00b4510 con 0x7fa7f00b1d30 2024-03-08T21:33:45.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7f4e00640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f00b1d30 0x7fa7f00b2180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009870 tx=0x7fa7e801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bd638c7eb0f832 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7ef400640 1 -- 172.21.15.119:0/906660475 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80a7070 con 0x7fa7f00b1d30 2024-03-08T21:33:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7ef400640 1 -- 172.21.15.119:0/906660475 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e80b0070 con 0x7fa7f00b1d30 2024-03-08T21:33:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.828+0000 7fa7ef400640 1 -- 172.21.15.119:0/906660475 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80ab890 con 0x7fa7f00b1d30 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- 172.21.15.119:0/906660475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f00b1d30 msgr2=0x7fa7f00b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f00b1d30 0x7fa7f00b2180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009870 tx=0x7fa7e801c560 comp rx=0 tx=0).stop 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- 172.21.15.119:0/906660475 shutdown_connections 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f00b1d30 0x7fa7f00b2180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/906660475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f009a8d0 0x7fa7f009ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- 172.21.15.119:0/906660475 >> 172.21.15.119:0/906660475 conn(0x7fa7f006c620 msgr2=0x7fa7f006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- 172.21.15.119:0/906660475 shutdown_connections 2024-03-08T21:33:45.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- 172.21.15.119:0/906660475 wait complete. 2024-03-08T21:33:45.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 Processor -- start 2024-03-08T21:33:45.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- start start 2024-03-08T21:33:45.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 0x7fa7f00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f00b1d30 0x7fa7f0144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f01522d0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0152150 con 0x7fa7f0099ca0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f6e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0152450 con 0x7fa7f00b1d30 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40454/0 (socket says 172.21.15.119:40454) 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 -- 172.21.15.119:0/1766662278 learned_addr learned my addr 172.21.15.119:0/1766662278 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7efe00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 0x7fa7f00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7f4e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f00b1d30 0x7fa7f0144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 -- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f00b1d30 msgr2=0x7fa7f0144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f00b1d30 0x7fa7f0144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 -- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 msgr2=0x7fa7f00b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 0x7fa7f00b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7e7400640 1 -- 172.21.15.119:0/1766662278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0143830 con 0x7fa7f009a8d0 2024-03-08T21:33:45.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.832+0000 7fa7efe00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 0x7fa7f00b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:45.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7e7400640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800e870 tx=0x7fa7d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8017070 con 0x7fa7f009a8d0 2024-03-08T21:33:45.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800c940 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800ccf0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00aeaf0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f00b0d10 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0067db0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa7d801a070 con 0x7fa7f009a8d0 2024-03-08T21:33:45.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 0x7fa7cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:45.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7d80853a0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7efe00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 0x7fa7cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:45.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.836+0000 7fa7efe00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 0x7fa7cc069b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0001d70 tx=0x7fa7e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:45.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.840+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa7d8055d10 con 0x7fa7f009a8d0 2024-03-08T21:33:45.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7f00686e0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7ecc00640 1 -- 172.21.15.119:0/1766662278 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa7d8059db0 con 0x7fa7f009a8d0 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:33:45.983 INFO:teuthology.orchestra.run.smithi119.stdout:] 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 msgr2=0x7fa7cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 0x7fa7cc069b20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0001d70 tx=0x7fa7e0009040 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 msgr2=0x7fa7f00b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800e870 tx=0x7fa7d800ec70 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 shutdown_connections 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7cc067660 0x7fa7cc069b20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7f00b1d30 0x7fa7f0144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f009a8d0 0x7fa7f00b7d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 --2- 172.21.15.119:0/1766662278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7f0099ca0 0x7fa7f00b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 >> 172.21.15.119:0/1766662278 conn(0x7fa7f006c620 msgr2=0x7fa7f013bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 shutdown_connections 2024-03-08T21:33:45.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:45.996+0000 7fa7f6e00640 1 -- 172.21.15.119:0/1766662278 wait complete. 2024-03-08T21:33:46.003 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-08T21:33:46.003 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-08T21:33:46.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.152+0000 7f2f93800640 1 Processor -- start 2024-03-08T21:33:46.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 -- start start 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 0x7f2f8c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c06cc20 con 0x7f2f8c06c840 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3670 con 0x7f2f8c140fb0 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f93800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3950 con 0x7f2f8c144740 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f91800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 0x7f2f8c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f91800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:40110/0 (socket says 172.21.15.119:40110) 2024-03-08T21:33:46.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f91800640 1 -- 172.21.15.119:0/728324625 learned_addr learned my addr 172.21.15.119:0/728324625 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f83e00640 1 -- 172.21.15.119:0/728324625 >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 msgr2=0x7f2f8c141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f83e00640 1 --2- 172.21.15.119:0/728324625 >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f83e00640 1 -- 172.21.15.119:0/728324625 >> v1:172.21.15.160:6789/0 conn(0x7f2f8c06c840 legacy=0x7f2f8c144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f83e00640 1 -- 172.21.15.119:0/728324625 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c141960 con 0x7f2f8c144740 2024-03-08T21:33:46.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.156+0000 7f2f91800640 1 --2- 172.21.15.119:0/728324625 >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f83e00640 1 --2- 172.21.15.119:0/728324625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 0x7f2f8c0b3090 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f740097c0 tx=0x7f2f7401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96300141fac0350 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f8be00640 1 -- 172.21.15.119:0/728324625 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740b0070 con 0x7f2f8c144740 2024-03-08T21:33:46.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f8be00640 1 -- 172.21.15.119:0/728324625 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f740ab600 con 0x7f2f8c144740 2024-03-08T21:33:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f8be00640 1 -- 172.21.15.119:0/728324625 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740ab9d0 con 0x7f2f8c144740 2024-03-08T21:33:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- 172.21.15.119:0/728324625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 msgr2=0x7f2f8c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 --2- 172.21.15.119:0/728324625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 0x7f2f8c0b3090 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f740097c0 tx=0x7f2f7401c410 comp rx=0 tx=0).stop 2024-03-08T21:33:46.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- 172.21.15.119:0/728324625 shutdown_connections 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 --2- 172.21.15.119:0/728324625 >> v2:172.21.15.160:3300/0 conn(0x7f2f8c140fb0 0x7f2f8c141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 --2- 172.21.15.119:0/728324625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c144740 0x7f2f8c0b3090 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- 172.21.15.119:0/728324625 >> 172.21.15.119:0/728324625 conn(0x7f2f8c09a230 msgr2=0x7f2f8c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- 172.21.15.119:0/728324625 shutdown_connections 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- 172.21.15.119:0/728324625 wait complete. 2024-03-08T21:33:46.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 Processor -- start 2024-03-08T21:33:46.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 -- start start 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c06c840 0x7f2f8c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.160+0000 7f2f93800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f8c144740 0x7f2f8c13ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06da10 con 0x7f2f8c140fb0 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06d890 con 0x7f2f8c144740 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06db90 con 0x7f2f8c06c840 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f90e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c06c840 0x7f2f8c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40462/0 (socket says 172.21.15.119:40462) 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 -- 172.21.15.119:0/3487606242 learned_addr learned my addr 172.21.15.119:0/3487606242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:46.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f91800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f8c144740 0x7f2f8c13ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 -- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c06c840 msgr2=0x7f2f8c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c06c840 0x7f2f8c0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 -- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f8c144740 msgr2=0x7f2f8c13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f8c144740 0x7f2f8c13ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 -- 172.21.15.119:0/3487606242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c070900 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f83e00640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f740ae040 tx=0x7f2f740191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740b8020 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f740b4410 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c070be0 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740b0040 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c13f1b0 con 0x7f2f8c140fb0 2024-03-08T21:33:46.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c068550 con 0x7f2f8c140fb0 2024-03-08T21:33:46.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.164+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2f740bb020 con 0x7f2f8c140fb0 2024-03-08T21:33:46.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.168+0000 7f2f89600640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 0x7f2f68069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:46.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.168+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f7411ef30 con 0x7f2f8c140fb0 2024-03-08T21:33:46.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.168+0000 7f2f90e00640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 0x7f2f68069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:46.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.168+0000 7f2f90e00640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 0x7f2f68069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c13e610 tx=0x7f2f7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:46.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.172+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2f8c068550 con 0x7f2f8c140fb0 2024-03-08T21:33:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:46.343+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2f8c067db0 con 0x7f2f8c140fb0 2024-03-08T21:33:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.279+0000 7f2f89600640 1 -- 172.21.15.119:0/3487606242 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2f740c2030 con 0x7f2f8c140fb0 2024-03-08T21:33:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2024-03-08T21:33:47.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 msgr2=0x7f2f68069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 0x7f2f68069b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c13e610 tx=0x7f2f7c009040 comp rx=0 tx=0).stop 2024-03-08T21:33:47.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 msgr2=0x7f2f8c1479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f740ae040 tx=0x7f2f740191b0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 shutdown_connections 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2f68067660 0x7f2f68069b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f8c144740 0x7f2f8c13ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f8c140fb0 0x7f2f8c1479d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 --2- 172.21.15.119:0/3487606242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f8c06c840 0x7f2f8c0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 >> 172.21.15.119:0/3487606242 conn(0x7f2f8c09a230 msgr2=0x7f2f8c073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 shutdown_connections 2024-03-08T21:33:47.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.283+0000 7f2f93800640 1 -- 172.21.15.119:0/3487606242 wait complete. 2024-03-08T21:33:47.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-08T21:33:47.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 Processor -- start 2024-03-08T21:33:47.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 -- start start 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa21814e530 0x7fa218150920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21809e660 con 0x7fa2180b3f00 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180b4c20 con 0x7fa2180b4840 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.455+0000 7fa21fa00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180b2eb0 con 0x7fa21814e530 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa20fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa2180b3f00 0x7fa21809df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58742/0 (socket says 172.21.15.119:58742) 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa20fe00640 1 -- 172.21.15.119:0/3027953400 learned_addr learned my addr 172.21.15.119:0/3027953400 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:47.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa21da00640 1 --2- 172.21.15.119:0/3027953400 >> v2:172.21.15.160:3300/0 conn(0x7fa21814e530 0x7fa218150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:47.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713636249 0 0) 0x7fa21809e660 con 0x7fa2180b3f00 2024-03-08T21:33:47.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1fc003530 con 0x7fa2180b3f00 2024-03-08T21:33:47.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591390871 0 0) 0x7fa1fc003530 con 0x7fa2180b3f00 2024-03-08T21:33:47.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa21da00640 1 -- 172.21.15.119:0/3027953400 >> v1:172.21.15.160:6789/0 conn(0x7fa2180b4840 legacy=0x7fa218144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa21da00640 1 -- 172.21.15.119:0/3027953400 >> v1:172.21.15.119:6789/0 conn(0x7fa2180b3f00 legacy=0x7fa21809df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa21da00640 1 -- 172.21.15.119:0/3027953400 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180b3100 con 0x7fa21814e530 2024-03-08T21:33:47.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.459+0000 7fa21da00640 1 --2- 172.21.15.119:0/3027953400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21814e530 0x7fa218150920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa210009d90 tx=0x7fa21001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e298f2f7c4b2002 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:47.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b1070 con 0x7fa21814e530 2024-03-08T21:33:47.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2100a4950 con 0x7fa21814e530 2024-03-08T21:33:47.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa217e00640 1 -- 172.21.15.119:0/3027953400 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180b3c60 con 0x7fa21814e530 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- 172.21.15.119:0/3027953400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21814e530 msgr2=0x7fa218150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 --2- 172.21.15.119:0/3027953400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21814e530 0x7fa218150920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa210009d90 tx=0x7fa21001c390 comp rx=0 tx=0).stop 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- 172.21.15.119:0/3027953400 shutdown_connections 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 --2- 172.21.15.119:0/3027953400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa21814e530 0x7fa218150920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- 172.21.15.119:0/3027953400 >> 172.21.15.119:0/3027953400 conn(0x7fa2180b4fb0 msgr2=0x7fa2180b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- 172.21.15.119:0/3027953400 shutdown_connections 2024-03-08T21:33:47.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- 172.21.15.119:0/3027953400 wait complete. 2024-03-08T21:33:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 Processor -- start 2024-03-08T21:33:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- start start 2024-03-08T21:33:47.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 0x7fa2181e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2180b4840 0x7fa21813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218154230 con 0x7fa21814e530 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181540b0 con 0x7fa2180b3f00 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21fa00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181543b0 con 0x7fa2180b4840 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40470/0 (socket says 172.21.15.119:40470) 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 -- 172.21.15.119:0/2580017639 learned_addr learned my addr 172.21.15.119:0/2580017639 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa20fe00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2180b4840 0x7fa21813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21d000640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 0x7fa2181e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 -- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2180b4840 msgr2=0x7fa21813f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2180b4840 0x7fa21813f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 -- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 msgr2=0x7fa2181e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 0x7fa2181e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21da00640 1 -- 172.21.15.119:0/2580017639 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218072610 con 0x7fa21814e530 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.463+0000 7fa21d000640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 0x7fa2181e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa21da00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa210009d90 tx=0x7fa210019450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2100b1040 con 0x7fa21814e530 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210003ba0 con 0x7fa21814e530 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21813fa40 con 0x7fa21814e530 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200001680 con 0x7fa21814e530 2024-03-08T21:33:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa218141bb0 con 0x7fa21814e530 2024-03-08T21:33:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218067db0 con 0x7fa21814e530 2024-03-08T21:33:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa210004030 con 0x7fa21814e530 2024-03-08T21:33:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 0x7fa1f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa21011fce0 con 0x7fa21814e530 2024-03-08T21:33:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.467+0000 7fa21d000640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 0x7fa1f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:47.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.471+0000 7fa21d000640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 0x7fa1f4069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa208000f70 tx=0x7fa208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:47.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.475+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa210016480 con 0x7fa21814e530 2024-03-08T21:33:47.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:47.631+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa218067db0 con 0x7fa21814e530 2024-03-08T21:33:47.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:33:47.702 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:33:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.283+0000 7fa215600640 1 -- 172.21.15.119:0/2580017639 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2100f0c70 con 0x7fa21814e530 2024-03-08T21:33:48.273 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 msgr2=0x7fa1f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 0x7fa1f4069b20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa208000f70 tx=0x7fa208009040 comp rx=0 tx=0).stop 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 msgr2=0x7fa21813e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa210009d90 tx=0x7fa210019450 comp rx=0 tx=0).stop 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 shutdown_connections 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1f4067660 0x7fa1f4069b20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21814e530 0x7fa21813e270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2180b4840 0x7fa21813f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 --2- 172.21.15.119:0/2580017639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2180b3f00 0x7fa2181e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 >> 172.21.15.119:0/2580017639 conn(0x7fa2180b4fb0 msgr2=0x7fa2181441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 shutdown_connections 2024-03-08T21:33:48.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.287+0000 7fa21fa00640 1 -- 172.21.15.119:0/2580017639 wait complete. 2024-03-08T21:33:48.312 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-08T21:33:48.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 Processor -- start 2024-03-08T21:33:48.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 -- start start 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0880ad600 0x7ff0880b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088072cb0 0x7ff088147030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880b4a50 con 0x7ff088147570 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0880ae9d0 con 0x7ff0880ad600 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff08cc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b4d90 con 0x7ff088072cb0 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0880ad600 0x7ff0880b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff088147570 0x7ff088143ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58754/0 (socket says 172.21.15.119:58754) 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087e00640 1 -- 172.21.15.119:0/2203923981 learned_addr learned my addr 172.21.15.119:0/2203923981 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:48.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff086a00640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088072cb0 0x7ff088147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087400640 1 -- 172.21.15.119:0/2203923981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088072cb0 msgr2=0x7ff088147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:48.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087400640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088072cb0 0x7ff088147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087400640 1 -- 172.21.15.119:0/2203923981 >> v1:172.21.15.119:6789/0 conn(0x7ff088147570 legacy=0x7ff088143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff087400640 1 -- 172.21.15.119:0/2203923981 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880ad9e0 con 0x7ff0880ad600 2024-03-08T21:33:48.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.463+0000 7ff086000640 1 -- 172.21.15.119:0/2203923981 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690085697 0 0) 0x7ff0880b4a50 con 0x7ff088147570 2024-03-08T21:33:48.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff087400640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ad600 0x7ff0880b4140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097c0 tx=0x7ff07801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb53e1dc92d734d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:48.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff086000640 1 -- 172.21.15.119:0/2203923981 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0780b0070 con 0x7ff0880ad600 2024-03-08T21:33:48.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff086000640 1 -- 172.21.15.119:0/2203923981 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0780ab600 con 0x7ff0880ad600 2024-03-08T21:33:48.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff086000640 1 -- 172.21.15.119:0/2203923981 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0780ab9d0 con 0x7ff0880ad600 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- 172.21.15.119:0/2203923981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ad600 msgr2=0x7ff0880b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ad600 0x7ff0880b4140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097c0 tx=0x7ff07801c410 comp rx=0 tx=0).stop 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- 172.21.15.119:0/2203923981 shutdown_connections 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088072cb0 0x7ff088147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 --2- 172.21.15.119:0/2203923981 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0880ad600 0x7ff0880b4140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- 172.21.15.119:0/2203923981 >> 172.21.15.119:0/2203923981 conn(0x7ff0880b8380 msgr2=0x7ff0880b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:48.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- 172.21.15.119:0/2203923981 shutdown_connections 2024-03-08T21:33:48.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- 172.21.15.119:0/2203923981 wait complete. 2024-03-08T21:33:48.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 Processor -- start 2024-03-08T21:33:48.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.467+0000 7ff08cc00640 1 -- start start 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 0x7ff08806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 0x7ff088070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b4800 con 0x7ff088072cb0 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b4680 con 0x7ff0880ad600 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881513c0 con 0x7ff088070ea0 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40480/0 (socket says 172.21.15.119:40480) 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 -- 172.21.15.119:0/202785741 learned_addr learned my addr 172.21.15.119:0/202785741 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff086a00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 0x7ff08806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 -- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 msgr2=0x7ff088070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087e00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 0x7ff088070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 0x7ff088070170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 -- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 msgr2=0x7ff08806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 0x7ff08806fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 -- 172.21.15.119:0/202785741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088071c90 con 0x7ff088072cb0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff086a00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 0x7ff08806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087e00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 0x7ff088070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff087400640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097c0 tx=0x7ff07801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0780b0040 con 0x7ff088072cb0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078004030 con 0x7ff088072cb0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078004400 con 0x7ff088072cb0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880713f0 con 0x7ff088072cb0 2024-03-08T21:33:48.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08809cd50 con 0x7ff088072cb0 2024-03-08T21:33:48.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.471+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff088067db0 con 0x7ff088072cb0 2024-03-08T21:33:48.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.475+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff078003620 con 0x7ff088072cb0 2024-03-08T21:33:48.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.475+0000 7ff07f400640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 0x7ff068069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:48.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.475+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff078120bb0 con 0x7ff088072cb0 2024-03-08T21:33:48.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.475+0000 7ff086a00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 0x7ff068069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:48.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.475+0000 7ff086a00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 0x7ff068069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff08813db10 tx=0x7ff074008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:48.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.479+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff078016090 con 0x7ff088072cb0 2024-03-08T21:33:48.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:48.667+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0880b79b0 con 0x7ff088072cb0 2024-03-08T21:33:49.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.315+0000 7ff07f400640 1 -- 172.21.15.119:0/202785741 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff0780f1b20 con 0x7ff088072cb0 2024-03-08T21:33:49.308 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 2 and data pool 3 2024-03-08T21:33:49.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.327+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 msgr2=0x7ff068069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.327+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 0x7ff068069b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff08813db10 tx=0x7ff074008040 comp rx=0 tx=0).stop 2024-03-08T21:33:49.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.327+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 msgr2=0x7ff08809c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.327+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff0780097c0 tx=0x7ff07801ac50 comp rx=0 tx=0).stop 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 shutdown_connections 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff068067660 0x7ff068069b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff088070ea0 0x7ff088070170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0880ad600 0x7ff08806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 --2- 172.21.15.119:0/202785741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff088072cb0 0x7ff08809c470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.331+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 >> 172.21.15.119:0/202785741 conn(0x7ff0880b8380 msgr2=0x7ff0880b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:49.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.335+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 shutdown_connections 2024-03-08T21:33:49.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.335+0000 7ff08cc00640 1 -- 172.21.15.119:0/202785741 wait complete. 2024-03-08T21:33:49.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:49.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 Processor -- start 2024-03-08T21:33:49.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 -- start start 2024-03-08T21:33:49.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 0x7f2a401477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4006cde0 con 0x7f2a400b4540 2024-03-08T21:33:49.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a40148180 con 0x7f2a40147d30 2024-03-08T21:33:49.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a45600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4006ded0 con 0x7f2a40147370 2024-03-08T21:33:49.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2a400b4540 0x7f2a4006d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58758/0 (socket says 172.21.15.119:58758) 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3fe00640 1 -- 172.21.15.119:0/6497626 learned_addr learned my addr 172.21.15.119:0/6497626 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a37400640 1 --2- 172.21.15.119:0/6497626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 0x7f2a401477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986876889 0 0) 0x7f2a4006cde0 con 0x7f2a400b4540 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a24003530 con 0x7f2a400b4540 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481717919 0 0) 0x7f2a40148180 con 0x7f2a40147d30 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a4006cde0 con 0x7f2a40147d30 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a37400640 1 -- 172.21.15.119:0/6497626 >> v1:172.21.15.160:6789/0 conn(0x7f2a40147d30 legacy=0x7f2a40151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a37400640 1 -- 172.21.15.119:0/6497626 >> v1:172.21.15.119:6789/0 conn(0x7f2a400b4540 legacy=0x7f2a4006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068715694 0 0) 0x7f2a24003530 con 0x7f2a400b4540 2024-03-08T21:33:49.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.503+0000 7f2a37400640 1 -- 172.21.15.119:0/6497626 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400b5590 con 0x7f2a40147370 2024-03-08T21:33:49.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a37400640 1 --2- 172.21.15.119:0/6497626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 0x7f2a401477f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a280097f0 tx=0x7f2a2801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cefb1fedd5f16999 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280b0070 con 0x7f2a40147370 2024-03-08T21:33:49.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280ab400 con 0x7f2a40147370 2024-03-08T21:33:49.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a3f400640 1 -- 172.21.15.119:0/6497626 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30001680 con 0x7f2a40147370 2024-03-08T21:33:49.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- 172.21.15.119:0/6497626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 msgr2=0x7f2a401477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 --2- 172.21.15.119:0/6497626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 0x7f2a401477f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2a280097f0 tx=0x7f2a2801c370 comp rx=0 tx=0).stop 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- 172.21.15.119:0/6497626 shutdown_connections 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 --2- 172.21.15.119:0/6497626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147370 0x7f2a401477f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- 172.21.15.119:0/6497626 >> 172.21.15.119:0/6497626 conn(0x7f2a4006b4b0 msgr2=0x7f2a400b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- 172.21.15.119:0/6497626 shutdown_connections 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- 172.21.15.119:0/6497626 wait complete. 2024-03-08T21:33:49.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 Processor -- start 2024-03-08T21:33:49.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.507+0000 7f2a45600640 1 -- start start 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a400b4540 0x7f2a400ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 0x7f2a40139300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4006d050 con 0x7f2a40147370 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b6e10 con 0x7f2a400b4540 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40073310 con 0x7f2a40147d30 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40492/0 (socket says 172.21.15.119:40492) 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 -- 172.21.15.119:0/4266588153 learned_addr learned my addr 172.21.15.119:0/4266588153 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a3fe00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a400b4540 0x7f2a400ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a44c00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 0x7f2a40139300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 -- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 msgr2=0x7f2a40139300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 0x7f2a40139300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 -- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a400b4540 msgr2=0x7f2a400ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a400b4540 0x7f2a400ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 -- 172.21.15.119:0/4266588153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400af310 con 0x7f2a40147370 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a44c00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 0x7f2a40139300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a37400640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a280ae040 tx=0x7f2a2801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280bb020 con 0x7f2a40147370 2024-03-08T21:33:49.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280b1040 con 0x7f2a40147370 2024-03-08T21:33:49.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a400af030 con 0x7f2a40147370 2024-03-08T21:33:49.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280b0050 con 0x7f2a40147370 2024-03-08T21:33:49.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a400ac9f0 con 0x7f2a40147370 2024-03-08T21:33:49.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400750f0 con 0x7f2a40147370 2024-03-08T21:33:49.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.511+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2a280be070 con 0x7f2a40147370 2024-03-08T21:33:49.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.515+0000 7f2a3cc00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 0x7f2a1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.515+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a2811f0b0 con 0x7f2a40147370 2024-03-08T21:33:49.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.515+0000 7f2a3fe00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 0x7f2a1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.515+0000 7f2a3fe00640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 0x7f2a1c069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a30000fe0 tx=0x7f2a30001720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.519+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2a400af310 con 0x7f2a40147370 2024-03-08T21:33:49.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.671+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a40142080 con 0x7f2a40147370 2024-03-08T21:33:49.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a3cc00640 1 -- 172.21.15.119:0/4266588153 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f2a28015ff0 con 0x7f2a40147370 2024-03-08T21:33:49.663 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:49.664 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":20,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:48.672424+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:49.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 msgr2=0x7f2a1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 0x7f2a1c069b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2a30000fe0 tx=0x7f2a30001720 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 msgr2=0x7f2a4013f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a280ae040 tx=0x7f2a2801abb0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 shutdown_connections 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a1c067660 0x7f2a1c069b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a40147d30 0x7f2a40139300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a40147370 0x7f2a4013f470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 --2- 172.21.15.119:0/4266588153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a400b4540 0x7f2a400ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 >> 172.21.15.119:0/4266588153 conn(0x7f2a4006b4b0 msgr2=0x7f2a400b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 shutdown_connections 2024-03-08T21:33:49.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.675+0000 7f2a45600640 1 -- 172.21.15.119:0/4266588153 wait complete. 2024-03-08T21:33:49.685 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:49.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 Processor -- start 2024-03-08T21:33:49.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 -- start start 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7f58066d30 0x7f7f5813e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f58072260 0x7f7f5813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f58067110 con 0x7f7f580b53c0 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f580b42c0 con 0x7f7f58072260 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5d600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f580b45a0 con 0x7f7f58066d30 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f58072260 0x7f7f5813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f58072260 0x7f7f5813eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40496/0 (socket says 172.21.15.119:40496) 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 -- 172.21.15.119:0/2135490207 learned_addr learned my addr 172.21.15.119:0/2135490207 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:49.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f57e00640 1 --2- 172.21.15.119:0/2135490207 >> v2:172.21.15.160:3300/0 conn(0x7f7f58066d30 0x7f7f5813e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 -- 172.21.15.119:0/2135490207 >> v2:172.21.15.160:3300/0 conn(0x7f7f58066d30 msgr2=0x7f7f5813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:49.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 --2- 172.21.15.119:0/2135490207 >> v2:172.21.15.160:3300/0 conn(0x7f7f58066d30 0x7f7f5813e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 -- 172.21.15.119:0/2135490207 >> v1:172.21.15.160:6789/0 conn(0x7f7f580b53c0 legacy=0x7f7f58071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.831+0000 7f7f5cc00640 1 -- 172.21.15.119:0/2135490207 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f580712c0 con 0x7f7f58072260 2024-03-08T21:33:49.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5cc00640 1 --2- 172.21.15.119:0/2135490207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f5813eee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009870 tx=0x7f7f5001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32968ebfaace3c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f57400640 1 -- 172.21.15.119:0/2135490207 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500b0070 con 0x7f7f58072260 2024-03-08T21:33:49.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f57400640 1 -- 172.21.15.119:0/2135490207 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f500ab600 con 0x7f7f58072260 2024-03-08T21:33:49.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f57400640 1 -- 172.21.15.119:0/2135490207 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f500ab9d0 con 0x7f7f58072260 2024-03-08T21:33:49.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- 172.21.15.119:0/2135490207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 msgr2=0x7f7f5813eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2135490207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f5813eee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009870 tx=0x7f7f5001c400 comp rx=0 tx=0).stop 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- 172.21.15.119:0/2135490207 shutdown_connections 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2135490207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f5813eee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2135490207 >> v2:172.21.15.160:3300/0 conn(0x7f7f58066d30 0x7f7f5813e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- 172.21.15.119:0/2135490207 >> 172.21.15.119:0/2135490207 conn(0x7f7f580b8f40 msgr2=0x7f7f580b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- 172.21.15.119:0/2135490207 shutdown_connections 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- 172.21.15.119:0/2135490207 wait complete. 2024-03-08T21:33:49.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 Processor -- start 2024-03-08T21:33:49.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.835+0000 7f7f5d600640 1 -- start start 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f58066d30 0x7f7f5813f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f580b53c0 0x7f7f581dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58152100 con 0x7f7f58072260 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58151f80 con 0x7f7f58066d30 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58152280 con 0x7f7f580b53c0 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40512/0 (socket says 172.21.15.119:40512) 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 -- 172.21.15.119:0/2895924614 learned_addr learned my addr 172.21.15.119:0/2895924614 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5cc00640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f580b53c0 0x7f7f581dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f57e00640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f58066d30 0x7f7f5813f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 -- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f580b53c0 msgr2=0x7f7f581dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f580b53c0 0x7f7f581dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 -- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f58066d30 msgr2=0x7f7f5813f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f58066d30 0x7f7f5813f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 -- 172.21.15.119:0/2895924614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f581406d0 con 0x7f7f58072260 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f4f400640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c730 tx=0x7f7f4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40016020 con 0x7f7f58072260 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40006d60 con 0x7f7f58072260 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f581409b0 con 0x7f7f58072260 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40003bc0 con 0x7f7f58072260 2024-03-08T21:33:49.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5813b0d0 con 0x7f7f58072260 2024-03-08T21:33:49.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f581404e0 con 0x7f7f58072260 2024-03-08T21:33:49.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.839+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7f4000a850 con 0x7f7f58072260 2024-03-08T21:33:49.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.843+0000 7f7f54c00640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 0x7f7f34069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:49.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.843+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f40085520 con 0x7f7f58072260 2024-03-08T21:33:49.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.843+0000 7f7f57e00640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 0x7f7f34069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:49.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.843+0000 7f7f57e00640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 0x7f7f34069b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f5813acd0 tx=0x7f7f48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:49.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.847+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7f40020020 con 0x7f7f58072260 2024-03-08T21:33:49.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.999+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f580750f0 con 0x7f7f58072260 2024-03-08T21:33:49.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:49.999+0000 7f7f54c00640 1 -- 172.21.15.119:0/2895924614 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16642 (secure 0 0 0) 0x7f7f40056190 con 0x7f7f58072260 2024-03-08T21:33:49.989 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:49.989 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":20,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:48.672424+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 msgr2=0x7f7f34069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 0x7f7f34069b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f5813acd0 tx=0x7f7f48008040 comp rx=0 tx=0).stop 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 msgr2=0x7f7f581df980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000c730 tx=0x7f7f4000cbf0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 shutdown_connections 2024-03-08T21:33:49.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7f34067690 0x7f7f34069b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f580b53c0 0x7f7f581dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f58072260 0x7f7f581df980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 --2- 172.21.15.119:0/2895924614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f58066d30 0x7f7f5813f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 >> 172.21.15.119:0/2895924614 conn(0x7f7f580b8f40 msgr2=0x7f7f58138340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 shutdown_connections 2024-03-08T21:33:49.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.003+0000 7f7f5d600640 1 -- 172.21.15.119:0/2895924614 wait complete. 2024-03-08T21:33:50.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-08T21:33:50.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 Processor -- start 2024-03-08T21:33:50.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 -- start start 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f776c0af380 0x7f776c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c0ae740 con 0x7f776c1444a0 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c067110 con 0x7f776c0af380 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7773c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b4320 con 0x7f776c066d30 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f776c0af380 0x7f776c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f776c0af380 0x7f776c143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40522/0 (socket says 172.21.15.119:40522) 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 -- 172.21.15.119:0/3197460760 learned_addr learned my addr 172.21.15.119:0/3197460760 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7771200640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 -- 172.21.15.119:0/3197460760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 msgr2=0x7f776c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 -- 172.21.15.119:0/3197460760 >> v1:172.21.15.160:6789/0 conn(0x7f776c1444a0 legacy=0x7f776c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:50.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f776be00640 1 -- 172.21.15.119:0/3197460760 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0b4c20 con 0x7f776c0af380 2024-03-08T21:33:50.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.159+0000 7f7771200640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:50.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f776be00640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c143f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7758009870 tx=0x7f775801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df5a5865cb60cc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:50.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f776b400640 1 -- 172.21.15.119:0/3197460760 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580b1070 con 0x7f776c0af380 2024-03-08T21:33:50.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f776b400640 1 -- 172.21.15.119:0/3197460760 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77580ac640 con 0x7f776c0af380 2024-03-08T21:33:50.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f776b400640 1 -- 172.21.15.119:0/3197460760 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580aca10 con 0x7f776c0af380 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- 172.21.15.119:0/3197460760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 msgr2=0x7f776c143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c143f60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7758009870 tx=0x7f775801c520 comp rx=0 tx=0).stop 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- 172.21.15.119:0/3197460760 shutdown_connections 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c143f60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 --2- 172.21.15.119:0/3197460760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- 172.21.15.119:0/3197460760 >> 172.21.15.119:0/3197460760 conn(0x7f776c0b5770 msgr2=0x7f776c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- 172.21.15.119:0/3197460760 shutdown_connections 2024-03-08T21:33:50.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- 172.21.15.119:0/3197460760 wait complete. 2024-03-08T21:33:50.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 Processor -- start 2024-03-08T21:33:50.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.163+0000 7f7773c00640 1 -- start start 2024-03-08T21:33:50.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776c1444a0 0x7f776c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c144910 con 0x7f776c0af380 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c06e300 con 0x7f776c1444a0 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c144a90 con 0x7f776c066d30 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40530/0 (socket says 172.21.15.119:40530) 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 -- 172.21.15.119:0/3599377286 learned_addr learned my addr 172.21.15.119:0/3599377286 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7771200640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7771c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776c1444a0 0x7f776c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 -- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 msgr2=0x7f776c0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 -- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776c1444a0 msgr2=0x7f776c070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776c1444a0 0x7f776c070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 -- 172.21.15.119:0/3599377286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0721a0 con 0x7f776c0af380 2024-03-08T21:33:50.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f776be00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f775801cdc0 tx=0x7f77580192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:50.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580b1040 con 0x7f776c0af380 2024-03-08T21:33:50.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77580b5440 con 0x7f776c0af380 2024-03-08T21:33:50.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c0b8960 con 0x7f776c0af380 2024-03-08T21:33:50.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580b5810 con 0x7f776c0af380 2024-03-08T21:33:50.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c13ca60 con 0x7f776c0af380 2024-03-08T21:33:50.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c067db0 con 0x7f776c0af380 2024-03-08T21:33:50.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.167+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f77580bc020 con 0x7f776c0af380 2024-03-08T21:33:50.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.171+0000 7f7768c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 0x7f774c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:50.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.171+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f775811ee10 con 0x7f776c0af380 2024-03-08T21:33:50.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.171+0000 7f7771200640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 0x7f774c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:50.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.171+0000 7f7771200640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 0x7f774c069b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f776000ab60 tx=0x7f7760008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:50.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.175+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7758122030 con 0x7f776c0af380 2024-03-08T21:33:50.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:50.367+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f776c13e4b0 con 0x7f776c0af380 2024-03-08T21:33:51.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7768c00640 1 -- 172.21.15.119:0/3599377286 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f77580c3020 con 0x7f776c0af380 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 msgr2=0x7f774c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 0x7f774c069b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f776000ab60 tx=0x7f7760008040 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 msgr2=0x7f776c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f775801cdc0 tx=0x7f77580192c0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 shutdown_connections 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f774c067690 0x7f774c069b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f776c1444a0 0x7f776c070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c0af380 0x7f776c070710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 --2- 172.21.15.119:0/3599377286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f776c066d30 0x7f776c0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 >> 172.21.15.119:0/3599377286 conn(0x7f776c0b5770 msgr2=0x7f776c0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:51.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 shutdown_connections 2024-03-08T21:33:51.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.327+0000 7f7773c00640 1 -- 172.21.15.119:0/3599377286 wait complete. 2024-03-08T21:33:51.338 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-08T21:33:51.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-08T21:33:51.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 Processor -- start 2024-03-08T21:33:51.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 -- start start 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f64d4072740 0x7f64d4072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d413f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d406bc80 con 0x7f64d4148310 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d406b1a0 con 0x7f64d4072740 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.487+0000 7f64dc000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d406b480 con 0x7f64d413ed70 2024-03-08T21:33:51.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f64d4072740 0x7f64d4072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f64d4072740 0x7f64d4072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40538/0 (socket says 172.21.15.119:40538) 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 -- 172.21.15.119:0/3553966617 learned_addr learned my addr 172.21.15.119:0/3553966617 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d8c00640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d413f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 -- 172.21.15.119:0/3553966617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 msgr2=0x7f64d413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d413f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 -- 172.21.15.119:0/3553966617 >> v1:172.21.15.160:6789/0 conn(0x7f64d4148310 legacy=0x7f64d4144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 -- 172.21.15.119:0/3553966617 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d406b760 con 0x7f64d4072740 2024-03-08T21:33:51.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d9600640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4072740 0x7f64d4072b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009870 tx=0x7f64c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a36846d1987c3b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:51.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d3e00640 1 -- 172.21.15.119:0/3553966617 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40b0070 con 0x7f64d4072740 2024-03-08T21:33:51.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d3e00640 1 -- 172.21.15.119:0/3553966617 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40ab600 con 0x7f64d4072740 2024-03-08T21:33:51.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.491+0000 7f64d3e00640 1 -- 172.21.15.119:0/3553966617 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40ab9d0 con 0x7f64d4072740 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3553966617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4072740 msgr2=0x7f64d4072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4072740 0x7f64d4072b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009870 tx=0x7f64c401c4d0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3553966617 shutdown_connections 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d413f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- 172.21.15.119:0/3553966617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4072740 0x7f64d4072b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3553966617 >> 172.21.15.119:0/3553966617 conn(0x7f64d40b6130 msgr2=0x7f64d40b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3553966617 shutdown_connections 2024-03-08T21:33:51.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3553966617 wait complete. 2024-03-08T21:33:51.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 Processor -- start 2024-03-08T21:33:51.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- start start 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64d4072740 0x7f64d4141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d41526c0 con 0x7f64d4148310 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40b5fb0 con 0x7f64d4072740 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4152840 con 0x7f64d413ed70 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40544/0 (socket says 172.21.15.119:40544) 2024-03-08T21:33:51.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 -- 172.21.15.119:0/3621207118 learned_addr learned my addr 172.21.15.119:0/3621207118 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64d9600640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64d4072740 0x7f64d4141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 -- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 msgr2=0x7f64d414e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 -- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64d4072740 msgr2=0x7f64d4141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64d4072740 0x7f64d4141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 -- 172.21.15.119:0/3621207118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d409c200 con 0x7f64d4148310 2024-03-08T21:33:51.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64da000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c760 tx=0x7f64cc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:51.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc003b80 con 0x7f64d4148310 2024-03-08T21:33:51.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc003d20 con 0x7f64d4148310 2024-03-08T21:33:51.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d414e980 con 0x7f64d4148310 2024-03-08T21:33:51.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc00aa30 con 0x7f64d4148310 2024-03-08T21:33:51.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.495+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d41502b0 con 0x7f64d4148310 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4067db0 con 0x7f64d4148310 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f64cc00abd0 con 0x7f64d4148310 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64d1600640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 0x7f64b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64cc085780 con 0x7f64d4148310 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64d9600640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 0x7f64b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:51.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.499+0000 7f64d9600640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 0x7f64b8069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64c40ad000 tx=0x7f64c40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:51.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.503+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f64d406bc80 con 0x7f64d4148310 2024-03-08T21:33:51.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:51.691+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f64d40b6c20 con 0x7f64d4148310 2024-03-08T21:33:52.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.327+0000 7f64d1600640 1 -- 172.21.15.119:0/3621207118 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64cc0563f0 con 0x7f64d4148310 2024-03-08T21:33:52.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 msgr2=0x7f64b8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 0x7f64b8069b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f64c40ad000 tx=0x7f64c40a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:52.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 msgr2=0x7f64d40b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00c760 tx=0x7f64cc00cc20 comp rx=0 tx=0).stop 2024-03-08T21:33:52.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 shutdown_connections 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f64b8067660 0x7f64b8069b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d4148310 0x7f64d40b0040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64d413ed70 0x7f64d414e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 --2- 172.21.15.119:0/3621207118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64d4072740 0x7f64d4141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 >> 172.21.15.119:0/3621207118 conn(0x7f64d40b6130 msgr2=0x7f64d40b86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 shutdown_connections 2024-03-08T21:33:52.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.331+0000 7f64dc000640 1 -- 172.21.15.119:0/3621207118 wait complete. 2024-03-08T21:33:52.340 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-08T21:33:52.341 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:33:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 Processor -- start 2024-03-08T21:33:52.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 -- start start 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94a806da10 0x7f94a80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a806ddf0 con 0x7f94a80b6440 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a80b6190 con 0x7f94a8141480 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94afc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80b4570 con 0x7f94a806da10 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94ad200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94a806da10 0x7f94a80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f949fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f94a80b6440 0x7f94a8140d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:58762/0 (socket says 172.21.15.119:58762) 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f949fe00640 1 -- 172.21.15.119:0/665516141 learned_addr learned my addr 172.21.15.119:0/665516141 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:52.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94ad200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94a806da10 0x7f94a80b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40548/0 (socket says 172.21.15.119:40548) 2024-03-08T21:33:52.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94ad200640 1 -- 172.21.15.119:0/665516141 >> v1:172.21.15.160:6789/0 conn(0x7f94a8141480 legacy=0x7f94a8151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:52.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94ad200640 1 -- 172.21.15.119:0/665516141 >> v1:172.21.15.119:6789/0 conn(0x7f94a80b6440 legacy=0x7f94a8140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94a7e00640 1 -- 172.21.15.119:0/665516141 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964173843 0 0) 0x7f94a806ddf0 con 0x7f94a80b6440 2024-03-08T21:33:52.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.491+0000 7f94ad200640 1 -- 172.21.15.119:0/665516141 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80b4850 con 0x7f94a806da10 2024-03-08T21:33:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94ad200640 1 --2- 172.21.15.119:0/665516141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a806da10 0x7f94a80b5560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94980097c0 tx=0x7f949801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e28b5e24cd944a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94a7e00640 1 -- 172.21.15.119:0/665516141 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980b0070 con 0x7f94a806da10 2024-03-08T21:33:52.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94a7e00640 1 -- 172.21.15.119:0/665516141 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94980ab600 con 0x7f94a806da10 2024-03-08T21:33:52.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94a7e00640 1 -- 172.21.15.119:0/665516141 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980ab9d0 con 0x7f94a806da10 2024-03-08T21:33:52.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- 172.21.15.119:0/665516141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a806da10 msgr2=0x7f94a80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 --2- 172.21.15.119:0/665516141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a806da10 0x7f94a80b5560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94980097c0 tx=0x7f949801c410 comp rx=0 tx=0).stop 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- 172.21.15.119:0/665516141 shutdown_connections 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 --2- 172.21.15.119:0/665516141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a806da10 0x7f94a80b5560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- 172.21.15.119:0/665516141 >> 172.21.15.119:0/665516141 conn(0x7f94a806b6e0 msgr2=0x7f94a80ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- 172.21.15.119:0/665516141 shutdown_connections 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- 172.21.15.119:0/665516141 wait complete. 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 Processor -- start 2024-03-08T21:33:52.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.495+0000 7f94afc00640 1 -- start start 2024-03-08T21:33:52.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a806da10 0x7f94a813d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b6440 0x7f94a813d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a81559a0 con 0x7f94a8141480 2024-03-08T21:33:52.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8155b20 con 0x7f94a80b6440 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a8155ca0 con 0x7f94a806da10 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:40556/0 (socket says 172.21.15.119:40556) 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 -- 172.21.15.119:0/1315695018 learned_addr learned my addr 172.21.15.119:0/1315695018 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94ad200640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a806da10 0x7f94a813d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f949fe00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b6440 0x7f94a813d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 -- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a806da10 msgr2=0x7f94a813d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a806da10 0x7f94a813d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 -- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b6440 msgr2=0x7f94a813d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b6440 0x7f94a813d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 -- 172.21.15.119:0/1315695018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a81e35e0 con 0x7f94a8141480 2024-03-08T21:33:52.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94adc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c730 tx=0x7f94a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0003b80 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a0003d20 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a81e38c0 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a000aa30 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a8135b90 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a8067db0 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.499+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f94a000abd0 con 0x7f94a8141480 2024-03-08T21:33:52.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.503+0000 7f94a5600640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 0x7f9484069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.503+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94a00855c0 con 0x7f94a8141480 2024-03-08T21:33:52.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.503+0000 7f94ad200640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 0x7f9484069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.503+0000 7f94ad200640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 0x7f9484069b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94980ad000 tx=0x7f94980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.507+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f94a0055bd0 con 0x7f94a8141480 2024-03-08T21:33:52.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94a806e070 con 0x7f94a8141480 2024-03-08T21:33:52.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94a5600640 1 -- 172.21.15.119:0/1315695018 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7f94a0059c70 con 0x7f94a8141480 2024-03-08T21:33:52.688 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:52.688 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:33:52.688 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 msgr2=0x7f9484069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 0x7f9484069b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94980ad000 tx=0x7f94980a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 msgr2=0x7f94a8146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c730 tx=0x7f94a000cbf0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 shutdown_connections 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9484067690 0x7f9484069b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94a8141480 0x7f94a8146810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b6440 0x7f94a813d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 --2- 172.21.15.119:0/1315695018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a806da10 0x7f94a813d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 >> 172.21.15.119:0/1315695018 conn(0x7f94a806b6e0 msgr2=0x7f94a813ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 shutdown_connections 2024-03-08T21:33:52.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.699+0000 7f94afc00640 1 -- 172.21.15.119:0/1315695018 wait complete. 2024-03-08T21:33:52.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:52.746 INFO:tasks.ceph.mds.a.smithi119.stderr:2024-03-08T21:33:52.755+0000 7f781ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T21:33:52.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 Processor -- start 2024-03-08T21:33:52.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 -- start start 2024-03-08T21:33:52.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 0x7f764409ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76440b1d30 0x7f76440b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76440b2680 con 0x7f7644099ca0 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440b4b60 con 0x7f76440b1d30 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f764b800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764409a080 con 0x7f764409a8d0 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76440b1d30 0x7f76440b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76440b1d30 0x7f76440b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43544/0 (socket says 172.21.15.119:43544) 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 -- 172.21.15.119:0/3655566560 learned_addr learned my addr 172.21.15.119:0/3655566560 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:52.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f763be00640 1 --2- 172.21.15.119:0/3655566560 >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 0x7f764409ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 -- 172.21.15.119:0/3655566560 >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 msgr2=0x7f764409ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:52.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 --2- 172.21.15.119:0/3655566560 >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 0x7f764409ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 -- 172.21.15.119:0/3655566560 >> v1:172.21.15.160:6789/0 conn(0x7f7644099ca0 legacy=0x7f764413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f7649800640 1 -- 172.21.15.119:0/3655566560 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440b4510 con 0x7f76440b1d30 2024-03-08T21:33:52.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.855+0000 7f763be00640 1 --2- 172.21.15.119:0/3655566560 >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 0x7f764409ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:52.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f7649800640 1 --2- 172.21.15.119:0/3655566560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76440b1d30 0x7f76440b2140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f764409a330 tx=0x7f763c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345778fbe432a5d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f7643e00640 1 -- 172.21.15.119:0/3655566560 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0a57d0 con 0x7f76440b1d30 2024-03-08T21:33:52.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f7643e00640 1 -- 172.21.15.119:0/3655566560 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0a5970 con 0x7f76440b1d30 2024-03-08T21:33:52.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f7643e00640 1 -- 172.21.15.119:0/3655566560 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0a5d40 con 0x7f76440b1d30 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 -- 172.21.15.119:0/3655566560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76440b1d30 msgr2=0x7f76440b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 --2- 172.21.15.119:0/3655566560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76440b1d30 0x7f76440b2140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f764409a330 tx=0x7f763c01c9f0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 -- 172.21.15.119:0/3655566560 shutdown_connections 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 --2- 172.21.15.119:0/3655566560 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76440b1d30 0x7f76440b2140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 --2- 172.21.15.119:0/3655566560 >> v2:172.21.15.160:3300/0 conn(0x7f764409a8d0 0x7f764409ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 -- 172.21.15.119:0/3655566560 >> 172.21.15.119:0/3655566560 conn(0x7f764406c620 msgr2=0x7f764406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:52.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 -- 172.21.15.119:0/3655566560 shutdown_connections 2024-03-08T21:33:52.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.859+0000 7f764b800640 1 -- 172.21.15.119:0/3655566560 wait complete. 2024-03-08T21:33:52.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 Processor -- start 2024-03-08T21:33:52.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- start start 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644099ca0 0x7f76440b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76440b1d30 0x7f764409b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76441522d0 con 0x7f764409a8d0 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644152150 con 0x7f76440b1d30 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7644152450 con 0x7f7644099ca0 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43546/0 (socket says 172.21.15.119:43546) 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 -- 172.21.15.119:0/2049343416 learned_addr learned my addr 172.21.15.119:0/2049343416 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f7648e00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644099ca0 0x7f76440b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f7649800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76440b1d30 0x7f764409b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 -- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644099ca0 msgr2=0x7f76440b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644099ca0 0x7f76440b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 -- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76440b1d30 msgr2=0x7f764409b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76440b1d30 0x7f764409b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 -- 172.21.15.119:0/2049343416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764413e2b0 con 0x7f764409a8d0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f763be00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f762c00e840 tx=0x7f762c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c017070 con 0x7f764409a8d0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c00c8d0 con 0x7f764409a8d0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764413c820 con 0x7f764409a8d0 2024-03-08T21:33:52.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c00f040 con 0x7f764409a8d0 2024-03-08T21:33:52.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764413cde0 con 0x7f764409a8d0 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.863+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76440b8330 con 0x7f764409a8d0 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.867+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f762c01a070 con 0x7f764409a8d0 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.867+0000 7f7641600640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 0x7f7620069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.867+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f762c085510 con 0x7f764409a8d0 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.867+0000 7f7648e00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 0x7f7620069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:52.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.867+0000 7f7648e00640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 0x7f7620069b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76440b0e60 tx=0x7f7634009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:52.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:52.871+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f762c056180 con 0x7f764409a8d0 2024-03-08T21:33:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.023+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7644067db0 con 0x7f764409a8d0 2024-03-08T21:33:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f7641600640 1 -- 172.21.15.119:0/2049343416 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f762c055a80 con 0x7f764409a8d0 2024-03-08T21:33:53.015 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:53.015 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 msgr2=0x7f7620069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 0x7f7620069b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f76440b0e60 tx=0x7f7634009040 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 msgr2=0x7f764409b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f762c00e840 tx=0x7f762c00ed00 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 shutdown_connections 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7620067660 0x7f7620069b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76440b1d30 0x7f764409b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f764409a8d0 0x7f764409b3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 --2- 172.21.15.119:0/2049343416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644099ca0 0x7f76440b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 >> 172.21.15.119:0/2049343416 conn(0x7f764406c620 msgr2=0x7f764406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 shutdown_connections 2024-03-08T21:33:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.027+0000 7f764b800640 1 -- 172.21.15.119:0/2049343416 wait complete. 2024-03-08T21:33:53.035 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-08T21:33:53.036 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:33:53.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.219+0000 7f92a2400640 1 Processor -- start 2024-03-08T21:33:53.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 -- start start 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 0x7f929c143640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f929c072920 0x7f929c147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c0b5ef0 con 0x7f929c1406c0 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c146bb0 con 0x7f929c072920 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f92a2400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c09be30 con 0x7f929c0b5b10 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f929c072920 0x7f929c147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f929c072920 0x7f929c147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43554/0 (socket says 172.21.15.119:43554) 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 -- 172.21.15.119:0/1188577743 learned_addr learned my addr 172.21.15.119:0/1188577743 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 -- 172.21.15.119:0/1188577743 >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 msgr2=0x7f929c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f929b400640 1 --2- 172.21.15.119:0/1188577743 >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 0x7f929c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 --2- 172.21.15.119:0/1188577743 >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 0x7f929c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 -- 172.21.15.119:0/1188577743 >> v1:172.21.15.119:6789/0 conn(0x7f929c1406c0 legacy=0x7f929c140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f9292a00640 1 -- 172.21.15.119:0/1188577743 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c146e00 con 0x7f929c072920 2024-03-08T21:33:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f929aa00640 1 -- 172.21.15.119:0/1188577743 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650717270 0 0) 0x7f929c0b5ef0 con 0x7f929c1406c0 2024-03-08T21:33:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.223+0000 7f929b400640 1 --2- 172.21.15.119:0/1188577743 >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 0x7f929c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f9292a00640 1 --2- 172.21.15.119:0/1188577743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c072920 0x7f929c147600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f928400aa10 tx=0x7f928401d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4166913a642b3c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f929aa00640 1 -- 172.21.15.119:0/1188577743 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840b3070 con 0x7f929c072920 2024-03-08T21:33:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f929aa00640 1 -- 172.21.15.119:0/1188577743 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840a67d0 con 0x7f929c072920 2024-03-08T21:33:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f929aa00640 1 -- 172.21.15.119:0/1188577743 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400b040 con 0x7f929c072920 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- 172.21.15.119:0/1188577743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c072920 msgr2=0x7f929c147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 --2- 172.21.15.119:0/1188577743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c072920 0x7f929c147600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f928400aa10 tx=0x7f928401d7a0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- 172.21.15.119:0/1188577743 shutdown_connections 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 --2- 172.21.15.119:0/1188577743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c072920 0x7f929c147600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 --2- 172.21.15.119:0/1188577743 >> v2:172.21.15.160:3300/0 conn(0x7f929c0b5b10 0x7f929c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- 172.21.15.119:0/1188577743 >> 172.21.15.119:0/1188577743 conn(0x7f929c06c620 msgr2=0x7f929c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- 172.21.15.119:0/1188577743 shutdown_connections 2024-03-08T21:33:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- 172.21.15.119:0/1188577743 wait complete. 2024-03-08T21:33:53.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 Processor -- start 2024-03-08T21:33:53.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.227+0000 7f92a2400640 1 -- start start 2024-03-08T21:33:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f929c0b5b10 0x7f929c071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f929c0b24d0 0x7f929c13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c150070 con 0x7f929c1406c0 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c14fef0 con 0x7f929c0b24d0 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c1501f0 con 0x7f929c0b5b10 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43566/0 (socket says 172.21.15.119:43566) 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 -- 172.21.15.119:0/400601119 learned_addr learned my addr 172.21.15.119:0/400601119 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f929b400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f929c0b5b10 0x7f929c071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f929be00640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f929c0b24d0 0x7f929c13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 -- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f929c0b5b10 msgr2=0x7f929c071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f929c0b5b10 0x7f929c071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 -- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f929c0b24d0 msgr2=0x7f929c13c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f929c0b24d0 0x7f929c13c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 -- 172.21.15.119:0/400601119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c13c5a0 con 0x7f929c1406c0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9292a00640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f928400aa10 tx=0x7f928401bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840b3070 con 0x7f929c1406c0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840b5070 con 0x7f929c1406c0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c13c820 con 0x7f929c1406c0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840aea90 con 0x7f929c1406c0 2024-03-08T21:33:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c0af920 con 0x7f929c1406c0 2024-03-08T21:33:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c067db0 con 0x7f929c1406c0 2024-03-08T21:33:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f92840aec30 con 0x7f929c1406c0 2024-03-08T21:33:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.231+0000 7f9293e00640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 0x7f9278069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.235+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f928411f830 con 0x7f929c1406c0 2024-03-08T21:33:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.235+0000 7f929b400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 0x7f9278069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.235+0000 7f929b400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 0x7f9278069b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f928c00d620 tx=0x7f928c007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.239+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f929c13c5a0 con 0x7f929c1406c0 2024-03-08T21:33:53.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.391+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f929c0adba0 con 0x7f9278067690 2024-03-08T21:33:53.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.399+0000 7f9293e00640 1 -- 172.21.15.119:0/400601119 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251896 (secure 0 0 0) 0x7f929c0adba0 con 0x7f9278067690 2024-03-08T21:33:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:53.391 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:33:53.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 msgr2=0x7f9278069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 0x7f9278069b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f928c00d620 tx=0x7f928c007810 comp rx=0 tx=0).stop 2024-03-08T21:33:53.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 msgr2=0x7f929c1e0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f928400aa10 tx=0x7f928401bfe0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 shutdown_connections 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9278067690 0x7f9278069b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f929c0b24d0 0x7f929c13c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f929c1406c0 0x7f929c1e0980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 --2- 172.21.15.119:0/400601119 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f929c0b5b10 0x7f929c071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 >> 172.21.15.119:0/400601119 conn(0x7f929c06c620 msgr2=0x7f929c140b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 shutdown_connections 2024-03-08T21:33:53.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.403+0000 7f92a2400640 1 -- 172.21.15.119:0/400601119 wait complete. 2024-03-08T21:33:53.410 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-08T21:33:52.416536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218880,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755840,"statfs":{"total":773094113280,"available":772869980160,"internally_reserved":0,"allocated":2777088,"data_stored":1698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.129376"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342443+0000","last_change":"2024-03-08T21:33:49.338396+0000","last_active":"2024-03-08T21:33:49.342443+0000","last_peered":"2024-03-08T21:33:49.342443+0000","last_clean":"2024-03-08T21:33:49.342443+0000","last_became_active":"2024-03-08T21:33:49.336412+0000","last_became_peered":"2024-03-08T21:33:49.336412+0000","last_unstale":"2024-03-08T21:33:49.342443+0000","last_undegraded":"2024-03-08T21:33:49.342443+0000","last_fullsized":"2024-03-08T21:33:49.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328479+0000","last_change":"2024-03-08T21:33:49.346755+0000","last_active":"2024-03-08T21:33:50.328479+0000","last_peered":"2024-03-08T21:33:50.328479+0000","last_clean":"2024-03-08T21:33:50.328479+0000","last_became_active":"2024-03-08T21:33:49.345880+0000","last_became_peered":"2024-03-08T21:33:49.345880+0000","last_unstale":"2024-03-08T21:33:50.328479+0000","last_undegraded":"2024-03-08T21:33:50.328479+0000","last_fullsized":"2024-03-08T21:33:50.328479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355991+0000","last_change":"2024-03-08T21:33:49.352136+0000","last_active":"2024-03-08T21:33:49.355991+0000","last_peered":"2024-03-08T21:33:49.355991+0000","last_clean":"2024-03-08T21:33:49.355991+0000","last_became_active":"2024-03-08T21:33:49.351873+0000","last_became_peered":"2024-03-08T21:33:49.351873+0000","last_unstale":"2024-03-08T21:33:49.355991+0000","last_undegraded":"2024-03-08T21:33:49.355991+0000","last_fullsized":"2024-03-08T21:33:49.355991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:27:16.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352027+0000","last_change":"2024-03-08T21:33:49.345377+0000","last_active":"2024-03-08T21:33:49.352027+0000","last_peered":"2024-03-08T21:33:49.352027+0000","last_clean":"2024-03-08T21:33:49.352027+0000","last_became_active":"2024-03-08T21:33:49.344753+0000","last_became_peered":"2024-03-08T21:33:49.344753+0000","last_unstale":"2024-03-08T21:33:49.352027+0000","last_undegraded":"2024-03-08T21:33:49.352027+0000","last_fullsized":"2024-03-08T21:33:49.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341791+0000","last_change":"2024-03-08T21:33:49.335919+0000","last_active":"2024-03-08T21:33:49.341791+0000","last_peered":"2024-03-08T21:33:49.341791+0000","last_clean":"2024-03-08T21:33:49.341791+0000","last_became_active":"2024-03-08T21:33:49.335616+0000","last_became_peered":"2024-03-08T21:33:49.335616+0000","last_unstale":"2024-03-08T21:33:49.341791+0000","last_undegraded":"2024-03-08T21:33:49.341791+0000","last_fullsized":"2024-03-08T21:33:49.341791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352838+0000","last_change":"2024-03-08T21:33:49.349339+0000","last_active":"2024-03-08T21:33:49.352838+0000","last_peered":"2024-03-08T21:33:49.352838+0000","last_clean":"2024-03-08T21:33:49.352838+0000","last_became_active":"2024-03-08T21:33:49.348932+0000","last_became_peered":"2024-03-08T21:33:49.348932+0000","last_unstale":"2024-03-08T21:33:49.352838+0000","last_undegraded":"2024-03-08T21:33:49.352838+0000","last_fullsized":"2024-03-08T21:33:49.352838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341856+0000","last_change":"2024-03-08T21:33:49.327740+0000","last_active":"2024-03-08T21:33:49.341856+0000","last_peered":"2024-03-08T21:33:49.341856+0000","last_clean":"2024-03-08T21:33:49.341856+0000","last_became_active":"2024-03-08T21:33:49.327434+0000","last_became_peered":"2024-03-08T21:33:49.327434+0000","last_unstale":"2024-03-08T21:33:49.341856+0000","last_undegraded":"2024-03-08T21:33:49.341856+0000","last_fullsized":"2024-03-08T21:33:49.341856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343594+0000","last_change":"2024-03-08T21:33:49.336284+0000","last_active":"2024-03-08T21:33:49.343594+0000","last_peered":"2024-03-08T21:33:49.343594+0000","last_clean":"2024-03-08T21:33:49.343594+0000","last_became_active":"2024-03-08T21:33:49.335990+0000","last_became_peered":"2024-03-08T21:33:49.335990+0000","last_unstale":"2024-03-08T21:33:49.343594+0000","last_undegraded":"2024-03-08T21:33:49.343594+0000","last_fullsized":"2024-03-08T21:33:49.343594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:19.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342364+0000","last_change":"2024-03-08T21:33:49.337931+0000","last_active":"2024-03-08T21:33:49.342364+0000","last_peered":"2024-03-08T21:33:49.342364+0000","last_clean":"2024-03-08T21:33:49.342364+0000","last_became_active":"2024-03-08T21:33:49.337076+0000","last_became_peered":"2024-03-08T21:33:49.337076+0000","last_unstale":"2024-03-08T21:33:49.342364+0000","last_undegraded":"2024-03-08T21:33:49.342364+0000","last_fullsized":"2024-03-08T21:33:49.342364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335718+0000","last_change":"2024-03-08T21:33:49.334835+0000","last_active":"2024-03-08T21:33:50.335718+0000","last_peered":"2024-03-08T21:33:50.335718+0000","last_clean":"2024-03-08T21:33:50.335718+0000","last_became_active":"2024-03-08T21:33:49.334522+0000","last_became_peered":"2024-03-08T21:33:49.334522+0000","last_unstale":"2024-03-08T21:33:50.335718+0000","last_undegraded":"2024-03-08T21:33:50.335718+0000","last_fullsized":"2024-03-08T21:33:50.335718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335412+0000","last_change":"2024-03-08T21:33:49.340915+0000","last_active":"2024-03-08T21:33:50.335412+0000","last_peered":"2024-03-08T21:33:50.335412+0000","last_clean":"2024-03-08T21:33:50.335412+0000","last_became_active":"2024-03-08T21:33:49.340639+0000","last_became_peered":"2024-03-08T21:33:49.340639+0000","last_unstale":"2024-03-08T21:33:50.335412+0000","last_undegraded":"2024-03-08T21:33:50.335412+0000","last_fullsized":"2024-03-08T21:33:50.335412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348153+0000","last_change":"2024-03-08T21:33:49.332751+0000","last_active":"2024-03-08T21:33:49.348153+0000","last_peered":"2024-03-08T21:33:49.348153+0000","last_clean":"2024-03-08T21:33:49.348153+0000","last_became_active":"2024-03-08T21:33:49.332402+0000","last_became_peered":"2024-03-08T21:33:49.332402+0000","last_unstale":"2024-03-08T21:33:49.348153+0000","last_undegraded":"2024-03-08T21:33:49.348153+0000","last_fullsized":"2024-03-08T21:33:49.348153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:29:16.596294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342272+0000","last_change":"2024-03-08T21:33:49.330189+0000","last_active":"2024-03-08T21:33:49.342272+0000","last_peered":"2024-03-08T21:33:49.342272+0000","last_clean":"2024-03-08T21:33:49.342272+0000","last_became_active":"2024-03-08T21:33:49.327014+0000","last_became_peered":"2024-03-08T21:33:49.327014+0000","last_unstale":"2024-03-08T21:33:49.342272+0000","last_undegraded":"2024-03-08T21:33:49.342272+0000","last_fullsized":"2024-03-08T21:33:49.342272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:10.185170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347074+0000","last_change":"2024-03-08T21:33:49.341331+0000","last_active":"2024-03-08T21:33:49.347074+0000","last_peered":"2024-03-08T21:33:49.347074+0000","last_clean":"2024-03-08T21:33:49.347074+0000","last_became_active":"2024-03-08T21:33:49.341071+0000","last_became_peered":"2024-03-08T21:33:49.341071+0000","last_unstale":"2024-03-08T21:33:49.347074+0000","last_undegraded":"2024-03-08T21:33:49.347074+0000","last_fullsized":"2024-03-08T21:33:49.347074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:38.222178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328180+0000","last_change":"2024-03-08T21:33:49.333262+0000","last_active":"2024-03-08T21:33:50.328180+0000","last_peered":"2024-03-08T21:33:50.328180+0000","last_clean":"2024-03-08T21:33:50.328180+0000","last_became_active":"2024-03-08T21:33:49.332938+0000","last_became_peered":"2024-03-08T21:33:49.332938+0000","last_unstale":"2024-03-08T21:33:50.328180+0000","last_undegraded":"2024-03-08T21:33:50.328180+0000","last_fullsized":"2024-03-08T21:33:50.328180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353018+0000","last_change":"2024-03-08T21:33:49.349412+0000","last_active":"2024-03-08T21:33:49.353018+0000","last_peered":"2024-03-08T21:33:49.353018+0000","last_clean":"2024-03-08T21:33:49.353018+0000","last_became_active":"2024-03-08T21:33:49.349101+0000","last_became_peered":"2024-03-08T21:33:49.349101+0000","last_unstale":"2024-03-08T21:33:49.353018+0000","last_undegraded":"2024-03-08T21:33:49.353018+0000","last_fullsized":"2024-03-08T21:33:49.353018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352187+0000","last_change":"2024-03-08T21:33:49.345737+0000","last_active":"2024-03-08T21:33:49.352187+0000","last_peered":"2024-03-08T21:33:49.352187+0000","last_clean":"2024-03-08T21:33:49.352187+0000","last_became_active":"2024-03-08T21:33:49.345326+0000","last_became_peered":"2024-03-08T21:33:49.345326+0000","last_unstale":"2024-03-08T21:33:49.352187+0000","last_undegraded":"2024-03-08T21:33:49.352187+0000","last_fullsized":"2024-03-08T21:33:49.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328855+0000","last_change":"2024-03-08T21:33:49.341768+0000","last_active":"2024-03-08T21:33:50.328855+0000","last_peered":"2024-03-08T21:33:50.328855+0000","last_clean":"2024-03-08T21:33:50.328855+0000","last_became_active":"2024-03-08T21:33:49.340834+0000","last_became_peered":"2024-03-08T21:33:49.340834+0000","last_unstale":"2024-03-08T21:33:50.328855+0000","last_undegraded":"2024-03-08T21:33:50.328855+0000","last_fullsized":"2024-03-08T21:33:50.328855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.354688+0000","last_change":"2024-03-08T21:33:49.351201+0000","last_active":"2024-03-08T21:33:49.354688+0000","last_peered":"2024-03-08T21:33:49.354688+0000","last_clean":"2024-03-08T21:33:49.354688+0000","last_became_active":"2024-03-08T21:33:49.350871+0000","last_became_peered":"2024-03-08T21:33:49.350871+0000","last_unstale":"2024-03-08T21:33:49.354688+0000","last_undegraded":"2024-03-08T21:33:49.354688+0000","last_fullsized":"2024-03-08T21:33:49.354688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335320+0000","last_change":"2024-03-08T21:33:49.333002+0000","last_active":"2024-03-08T21:33:50.335320+0000","last_peered":"2024-03-08T21:33:50.335320+0000","last_clean":"2024-03-08T21:33:50.335320+0000","last_became_active":"2024-03-08T21:33:49.332612+0000","last_became_peered":"2024-03-08T21:33:49.332612+0000","last_unstale":"2024-03-08T21:33:50.335320+0000","last_undegraded":"2024-03-08T21:33:50.335320+0000","last_fullsized":"2024-03-08T21:33:50.335320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.336081+0000","last_change":"2024-03-08T21:33:49.325558+0000","last_active":"2024-03-08T21:33:49.336081+0000","last_peered":"2024-03-08T21:33:49.336081+0000","last_clean":"2024-03-08T21:33:49.336081+0000","last_became_active":"2024-03-08T21:33:49.325207+0000","last_became_peered":"2024-03-08T21:33:49.325207+0000","last_unstale":"2024-03-08T21:33:49.336081+0000","last_undegraded":"2024-03-08T21:33:49.336081+0000","last_fullsized":"2024-03-08T21:33:49.336081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:29:16.596294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.351999+0000","last_change":"2024-03-08T21:33:49.345431+0000","last_active":"2024-03-08T21:33:49.351999+0000","last_peered":"2024-03-08T21:33:49.351999+0000","last_clean":"2024-03-08T21:33:49.351999+0000","last_became_active":"2024-03-08T21:33:49.344751+0000","last_became_peered":"2024-03-08T21:33:49.344751+0000","last_unstale":"2024-03-08T21:33:49.351999+0000","last_undegraded":"2024-03-08T21:33:49.351999+0000","last_fullsized":"2024-03-08T21:33:49.351999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342227+0000","last_change":"2024-03-08T21:33:49.329867+0000","last_active":"2024-03-08T21:33:49.342227+0000","last_peered":"2024-03-08T21:33:49.342227+0000","last_clean":"2024-03-08T21:33:49.342227+0000","last_became_active":"2024-03-08T21:33:49.329548+0000","last_became_peered":"2024-03-08T21:33:49.329548+0000","last_unstale":"2024-03-08T21:33:49.342227+0000","last_undegraded":"2024-03-08T21:33:49.342227+0000","last_fullsized":"2024-03-08T21:33:49.342227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:45.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346746+0000","last_change":"2024-03-08T21:33:49.343224+0000","last_active":"2024-03-08T21:33:49.346746+0000","last_peered":"2024-03-08T21:33:49.346746+0000","last_clean":"2024-03-08T21:33:49.346746+0000","last_became_active":"2024-03-08T21:33:49.342845+0000","last_became_peered":"2024-03-08T21:33:49.342845+0000","last_unstale":"2024-03-08T21:33:49.346746+0000","last_undegraded":"2024-03-08T21:33:49.346746+0000","last_fullsized":"2024-03-08T21:33:49.346746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:35.410658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343574+0000","last_change":"2024-03-08T21:33:49.338081+0000","last_active":"2024-03-08T21:33:49.343574+0000","last_peered":"2024-03-08T21:33:49.343574+0000","last_clean":"2024-03-08T21:33:49.343574+0000","last_became_active":"2024-03-08T21:33:49.337826+0000","last_became_peered":"2024-03-08T21:33:49.337826+0000","last_unstale":"2024-03-08T21:33:49.343574+0000","last_undegraded":"2024-03-08T21:33:49.343574+0000","last_fullsized":"2024-03-08T21:33:49.343574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335721+0000","last_change":"2024-03-08T21:33:49.343833+0000","last_active":"2024-03-08T21:33:50.335721+0000","last_peered":"2024-03-08T21:33:50.335721+0000","last_clean":"2024-03-08T21:33:50.335721+0000","last_became_active":"2024-03-08T21:33:49.342474+0000","last_became_peered":"2024-03-08T21:33:49.342474+0000","last_unstale":"2024-03-08T21:33:50.335721+0000","last_undegraded":"2024-03-08T21:33:50.335721+0000","last_fullsized":"2024-03-08T21:33:50.335721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328615+0000","last_change":"2024-03-08T21:33:49.344117+0000","last_active":"2024-03-08T21:33:50.328615+0000","last_peered":"2024-03-08T21:33:50.328615+0000","last_clean":"2024-03-08T21:33:50.328615+0000","last_became_active":"2024-03-08T21:33:49.343840+0000","last_became_peered":"2024-03-08T21:33:49.343840+0000","last_unstale":"2024-03-08T21:33:50.328615+0000","last_undegraded":"2024-03-08T21:33:50.328615+0000","last_fullsized":"2024-03-08T21:33:50.328615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343674+0000","last_change":"2024-03-08T21:33:49.338130+0000","last_active":"2024-03-08T21:33:49.343674+0000","last_peered":"2024-03-08T21:33:49.343674+0000","last_clean":"2024-03-08T21:33:49.343674+0000","last_became_active":"2024-03-08T21:33:49.337923+0000","last_became_peered":"2024-03-08T21:33:49.337923+0000","last_unstale":"2024-03-08T21:33:49.343674+0000","last_undegraded":"2024-03-08T21:33:49.343674+0000","last_fullsized":"2024-03-08T21:33:49.343674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347440+0000","last_change":"2024-03-08T21:33:49.338988+0000","last_active":"2024-03-08T21:33:49.347440+0000","last_peered":"2024-03-08T21:33:49.347440+0000","last_clean":"2024-03-08T21:33:49.347440+0000","last_became_active":"2024-03-08T21:33:49.338156+0000","last_became_peered":"2024-03-08T21:33:49.338156+0000","last_unstale":"2024-03-08T21:33:49.347440+0000","last_undegraded":"2024-03-08T21:33:49.347440+0000","last_fullsized":"2024-03-08T21:33:49.347440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:05:04.726067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352185+0000","last_change":"2024-03-08T21:33:49.345748+0000","last_active":"2024-03-08T21:33:49.352185+0000","last_peered":"2024-03-08T21:33:49.352185+0000","last_clean":"2024-03-08T21:33:49.352185+0000","last_became_active":"2024-03-08T21:33:49.345428+0000","last_became_peered":"2024-03-08T21:33:49.345428+0000","last_unstale":"2024-03-08T21:33:49.352185+0000","last_undegraded":"2024-03-08T21:33:49.352185+0000","last_fullsized":"2024-03-08T21:33:49.352185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328975+0000","last_change":"2024-03-08T21:33:49.338873+0000","last_active":"2024-03-08T21:33:50.328975+0000","last_peered":"2024-03-08T21:33:50.328975+0000","last_clean":"2024-03-08T21:33:50.328975+0000","last_became_active":"2024-03-08T21:33:49.338055+0000","last_became_peered":"2024-03-08T21:33:49.338055+0000","last_unstale":"2024-03-08T21:33:50.328975+0000","last_undegraded":"2024-03-08T21:33:50.328975+0000","last_fullsized":"2024-03-08T21:33:50.328975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335228+0000","last_change":"2024-03-08T21:33:49.326802+0000","last_active":"2024-03-08T21:33:50.335228+0000","last_peered":"2024-03-08T21:33:50.335228+0000","last_clean":"2024-03-08T21:33:50.335228+0000","last_became_active":"2024-03-08T21:33:49.326507+0000","last_became_peered":"2024-03-08T21:33:49.326507+0000","last_unstale":"2024-03-08T21:33:50.335228+0000","last_undegraded":"2024-03-08T21:33:50.335228+0000","last_fullsized":"2024-03-08T21:33:50.335228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348111+0000","last_change":"2024-03-08T21:33:49.332694+0000","last_active":"2024-03-08T21:33:49.348111+0000","last_peered":"2024-03-08T21:33:49.348111+0000","last_clean":"2024-03-08T21:33:49.348111+0000","last_became_active":"2024-03-08T21:33:49.332330+0000","last_became_peered":"2024-03-08T21:33:49.332330+0000","last_unstale":"2024-03-08T21:33:49.348111+0000","last_undegraded":"2024-03-08T21:33:49.348111+0000","last_fullsized":"2024-03-08T21:33:49.348111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:00:35.543798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355728+0000","last_change":"2024-03-08T21:33:48.318511+0000","last_active":"2024-03-08T21:33:49.355728+0000","last_peered":"2024-03-08T21:33:49.355728+0000","last_clean":"2024-03-08T21:33:49.355728+0000","last_became_active":"2024-03-08T21:33:48.318248+0000","last_became_peered":"2024-03-08T21:33:48.318248+0000","last_unstale":"2024-03-08T21:33:49.355728+0000","last_undegraded":"2024-03-08T21:33:49.355728+0000","last_fullsized":"2024-03-08T21:33:49.355728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:41.855784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347419+0000","last_change":"2024-03-08T21:33:49.336639+0000","last_active":"2024-03-08T21:33:49.347419+0000","last_peered":"2024-03-08T21:33:49.347419+0000","last_clean":"2024-03-08T21:33:49.347419+0000","last_became_active":"2024-03-08T21:33:49.336391+0000","last_became_peered":"2024-03-08T21:33:49.336391+0000","last_unstale":"2024-03-08T21:33:49.347419+0000","last_undegraded":"2024-03-08T21:33:49.347419+0000","last_fullsized":"2024-03-08T21:33:49.347419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:15:32.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335233+0000","last_change":"2024-03-08T21:33:48.319438+0000","last_active":"2024-03-08T21:33:50.335233+0000","last_peered":"2024-03-08T21:33:50.335233+0000","last_clean":"2024-03-08T21:33:50.335233+0000","last_became_active":"2024-03-08T21:33:48.319140+0000","last_became_peered":"2024-03-08T21:33:48.319140+0000","last_unstale":"2024-03-08T21:33:50.335233+0000","last_undegraded":"2024-03-08T21:33:50.335233+0000","last_fullsized":"2024-03-08T21:33:50.335233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.323841+0000","last_change":"2024-03-08T21:33:48.320554+0000","last_active":"2024-03-08T21:33:49.323841+0000","last_peered":"2024-03-08T21:33:49.323841+0000","last_clean":"2024-03-08T21:33:49.323841+0000","last_became_active":"2024-03-08T21:33:48.320236+0000","last_became_peered":"2024-03-08T21:33:48.320236+0000","last_unstale":"2024-03-08T21:33:49.323841+0000","last_undegraded":"2024-03-08T21:33:49.323841+0000","last_fullsized":"2024-03-08T21:33:49.323841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:54.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342051+0000","last_change":"2024-03-08T21:33:49.329537+0000","last_active":"2024-03-08T21:33:49.342051+0000","last_peered":"2024-03-08T21:33:49.342051+0000","last_clean":"2024-03-08T21:33:49.342051+0000","last_became_active":"2024-03-08T21:33:49.329235+0000","last_became_peered":"2024-03-08T21:33:49.329235+0000","last_unstale":"2024-03-08T21:33:49.342051+0000","last_undegraded":"2024-03-08T21:33:49.342051+0000","last_fullsized":"2024-03-08T21:33:49.342051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:34.548585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.332165+0000","last_change":"2024-03-08T21:33:48.320328+0000","last_active":"2024-03-08T21:33:49.332165+0000","last_peered":"2024-03-08T21:33:49.332165+0000","last_clean":"2024-03-08T21:33:49.332165+0000","last_became_active":"2024-03-08T21:33:48.319881+0000","last_became_peered":"2024-03-08T21:33:48.319881+0000","last_unstale":"2024-03-08T21:33:49.332165+0000","last_undegraded":"2024-03-08T21:33:49.332165+0000","last_fullsized":"2024-03-08T21:33:49.332165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.344229+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.343942+0000","last_became_peered":"2024-03-08T21:33:49.343942+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335604+0000","last_change":"2024-03-08T21:33:48.331439+0000","last_active":"2024-03-08T21:33:50.335604+0000","last_peered":"2024-03-08T21:33:50.335604+0000","last_clean":"2024-03-08T21:33:50.335604+0000","last_became_active":"2024-03-08T21:33:48.331088+0000","last_became_peered":"2024-03-08T21:33:48.331088+0000","last_unstale":"2024-03-08T21:33:50.335604+0000","last_undegraded":"2024-03-08T21:33:50.335604+0000","last_fullsized":"2024-03-08T21:33:50.335604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.351733+0000","last_change":"2024-03-08T21:33:49.345091+0000","last_active":"2024-03-08T21:33:49.351733+0000","last_peered":"2024-03-08T21:33:49.351733+0000","last_clean":"2024-03-08T21:33:49.351733+0000","last_became_active":"2024-03-08T21:33:49.344796+0000","last_became_peered":"2024-03-08T21:33:49.344796+0000","last_unstale":"2024-03-08T21:33:49.351733+0000","last_undegraded":"2024-03-08T21:33:49.351733+0000","last_fullsized":"2024-03-08T21:33:49.351733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.329385+0000","last_change":"2024-03-08T21:33:48.336669+0000","last_active":"2024-03-08T21:33:49.329385+0000","last_peered":"2024-03-08T21:33:49.329385+0000","last_clean":"2024-03-08T21:33:49.329385+0000","last_became_active":"2024-03-08T21:33:48.336403+0000","last_became_peered":"2024-03-08T21:33:48.336403+0000","last_unstale":"2024-03-08T21:33:49.329385+0000","last_undegraded":"2024-03-08T21:33:49.329385+0000","last_fullsized":"2024-03-08T21:33:49.329385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348587+0000","last_change":"2024-03-08T21:33:49.339581+0000","last_active":"2024-03-08T21:33:49.348587+0000","last_peered":"2024-03-08T21:33:49.348587+0000","last_clean":"2024-03-08T21:33:49.348587+0000","last_became_active":"2024-03-08T21:33:49.332498+0000","last_became_peered":"2024-03-08T21:33:49.332498+0000","last_unstale":"2024-03-08T21:33:49.348587+0000","last_undegraded":"2024-03-08T21:33:49.348587+0000","last_fullsized":"2024-03-08T21:33:49.348587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:58.416650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328697+0000","last_change":"2024-03-08T21:33:48.326093+0000","last_active":"2024-03-08T21:33:50.328697+0000","last_peered":"2024-03-08T21:33:50.328697+0000","last_clean":"2024-03-08T21:33:50.328697+0000","last_became_active":"2024-03-08T21:33:48.325836+0000","last_became_peered":"2024-03-08T21:33:48.325836+0000","last_unstale":"2024-03-08T21:33:50.328697+0000","last_undegraded":"2024-03-08T21:33:50.328697+0000","last_fullsized":"2024-03-08T21:33:50.328697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.327423+0000","last_change":"2024-03-08T21:33:49.321155+0000","last_active":"2024-03-08T21:33:49.327423+0000","last_peered":"2024-03-08T21:33:49.327423+0000","last_clean":"2024-03-08T21:33:49.327423+0000","last_became_active":"2024-03-08T21:33:49.320883+0000","last_became_peered":"2024-03-08T21:33:49.320883+0000","last_unstale":"2024-03-08T21:33:49.327423+0000","last_undegraded":"2024-03-08T21:33:49.327423+0000","last_fullsized":"2024-03-08T21:33:49.327423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:10.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335352+0000","last_change":"2024-03-08T21:33:48.311111+0000","last_active":"2024-03-08T21:33:50.335352+0000","last_peered":"2024-03-08T21:33:50.335352+0000","last_clean":"2024-03-08T21:33:50.335352+0000","last_became_active":"2024-03-08T21:33:48.310608+0000","last_became_peered":"2024-03-08T21:33:48.310608+0000","last_unstale":"2024-03-08T21:33:50.335352+0000","last_undegraded":"2024-03-08T21:33:50.335352+0000","last_fullsized":"2024-03-08T21:33:50.335352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342953+0000","last_change":"2024-03-08T21:33:49.334300+0000","last_active":"2024-03-08T21:33:49.342953+0000","last_peered":"2024-03-08T21:33:49.342953+0000","last_clean":"2024-03-08T21:33:49.342953+0000","last_became_active":"2024-03-08T21:33:49.333906+0000","last_became_peered":"2024-03-08T21:33:49.333906+0000","last_unstale":"2024-03-08T21:33:49.342953+0000","last_undegraded":"2024-03-08T21:33:49.342953+0000","last_fullsized":"2024-03-08T21:33:49.342953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355133+0000","last_change":"2024-03-08T21:33:48.316480+0000","last_active":"2024-03-08T21:33:49.355133+0000","last_peered":"2024-03-08T21:33:49.355133+0000","last_clean":"2024-03-08T21:33:49.355133+0000","last_became_active":"2024-03-08T21:33:48.316135+0000","last_became_peered":"2024-03-08T21:33:48.316135+0000","last_unstale":"2024-03-08T21:33:49.355133+0000","last_undegraded":"2024-03-08T21:33:49.355133+0000","last_fullsized":"2024-03-08T21:33:49.355133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:09.644526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.327113+0000","last_change":"2024-03-08T21:33:49.324801+0000","last_active":"2024-03-08T21:33:49.327113+0000","last_peered":"2024-03-08T21:33:49.327113+0000","last_clean":"2024-03-08T21:33:49.327113+0000","last_became_active":"2024-03-08T21:33:49.324523+0000","last_became_peered":"2024-03-08T21:33:49.324523+0000","last_unstale":"2024-03-08T21:33:49.327113+0000","last_undegraded":"2024-03-08T21:33:49.327113+0000","last_fullsized":"2024-03-08T21:33:49.327113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:00:35.543798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325256+0000","last_change":"2024-03-08T21:33:48.324724+0000","last_active":"2024-03-08T21:33:49.325256+0000","last_peered":"2024-03-08T21:33:49.325256+0000","last_clean":"2024-03-08T21:33:49.325256+0000","last_became_active":"2024-03-08T21:33:48.324379+0000","last_became_peered":"2024-03-08T21:33:48.324379+0000","last_unstale":"2024-03-08T21:33:49.325256+0000","last_undegraded":"2024-03-08T21:33:49.325256+0000","last_fullsized":"2024-03-08T21:33:49.325256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341722+0000","last_change":"2024-03-08T21:33:49.331839+0000","last_active":"2024-03-08T21:33:49.341722+0000","last_peered":"2024-03-08T21:33:49.341722+0000","last_clean":"2024-03-08T21:33:49.341722+0000","last_became_active":"2024-03-08T21:33:49.329912+0000","last_became_peered":"2024-03-08T21:33:49.329912+0000","last_unstale":"2024-03-08T21:33:49.341722+0000","last_undegraded":"2024-03-08T21:33:49.341722+0000","last_fullsized":"2024-03-08T21:33:49.341722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335165+0000","last_change":"2024-03-08T21:33:48.311849+0000","last_active":"2024-03-08T21:33:50.335165+0000","last_peered":"2024-03-08T21:33:50.335165+0000","last_clean":"2024-03-08T21:33:50.335165+0000","last_became_active":"2024-03-08T21:33:48.310917+0000","last_became_peered":"2024-03-08T21:33:48.310917+0000","last_unstale":"2024-03-08T21:33:50.335165+0000","last_undegraded":"2024-03-08T21:33:50.335165+0000","last_fullsized":"2024-03-08T21:33:50.335165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335308+0000","last_change":"2024-03-08T21:33:49.326937+0000","last_active":"2024-03-08T21:33:50.335308+0000","last_peered":"2024-03-08T21:33:50.335308+0000","last_clean":"2024-03-08T21:33:50.335308+0000","last_became_active":"2024-03-08T21:33:49.326518+0000","last_became_peered":"2024-03-08T21:33:49.326518+0000","last_unstale":"2024-03-08T21:33:50.335308+0000","last_undegraded":"2024-03-08T21:33:50.335308+0000","last_fullsized":"2024-03-08T21:33:50.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328078+0000","last_change":"2024-03-08T21:33:48.318497+0000","last_active":"2024-03-08T21:33:50.328078+0000","last_peered":"2024-03-08T21:33:50.328078+0000","last_clean":"2024-03-08T21:33:50.328078+0000","last_became_active":"2024-03-08T21:33:48.317867+0000","last_became_peered":"2024-03-08T21:33:48.317867+0000","last_unstale":"2024-03-08T21:33:50.328078+0000","last_undegraded":"2024-03-08T21:33:50.328078+0000","last_fullsized":"2024-03-08T21:33:50.328078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341884+0000","last_change":"2024-03-08T21:33:49.329322+0000","last_active":"2024-03-08T21:33:49.341884+0000","last_peered":"2024-03-08T21:33:49.341884+0000","last_clean":"2024-03-08T21:33:49.341884+0000","last_became_active":"2024-03-08T21:33:49.328970+0000","last_became_peered":"2024-03-08T21:33:49.328970+0000","last_unstale":"2024-03-08T21:33:49.341884+0000","last_undegraded":"2024-03-08T21:33:49.341884+0000","last_fullsized":"2024-03-08T21:33:49.341884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353531+0000","last_change":"2024-03-08T21:33:48.313918+0000","last_active":"2024-03-08T21:33:49.353531+0000","last_peered":"2024-03-08T21:33:49.353531+0000","last_clean":"2024-03-08T21:33:49.353531+0000","last_became_active":"2024-03-08T21:33:48.313623+0000","last_became_peered":"2024-03-08T21:33:48.313623+0000","last_unstale":"2024-03-08T21:33:49.353531+0000","last_undegraded":"2024-03-08T21:33:49.353531+0000","last_fullsized":"2024-03-08T21:33:49.353531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:12:02.322314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341965+0000","last_change":"2024-03-08T21:33:49.337361+0000","last_active":"2024-03-08T21:33:49.341965+0000","last_peered":"2024-03-08T21:33:49.341965+0000","last_clean":"2024-03-08T21:33:49.341965+0000","last_became_active":"2024-03-08T21:33:49.337028+0000","last_became_peered":"2024-03-08T21:33:49.337028+0000","last_unstale":"2024-03-08T21:33:49.341965+0000","last_undegraded":"2024-03-08T21:33:49.341965+0000","last_fullsized":"2024-03-08T21:33:49.341965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329029+0000","last_change":"2024-03-08T21:33:48.310802+0000","last_active":"2024-03-08T21:33:50.329029+0000","last_peered":"2024-03-08T21:33:50.329029+0000","last_clean":"2024-03-08T21:33:50.329029+0000","last_became_active":"2024-03-08T21:33:48.310508+0000","last_became_peered":"2024-03-08T21:33:48.310508+0000","last_unstale":"2024-03-08T21:33:50.329029+0000","last_undegraded":"2024-03-08T21:33:50.329029+0000","last_fullsized":"2024-03-08T21:33:50.329029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342342+0000","last_change":"2024-03-08T21:33:49.337562+0000","last_active":"2024-03-08T21:33:49.342342+0000","last_peered":"2024-03-08T21:33:49.342342+0000","last_clean":"2024-03-08T21:33:49.342342+0000","last_became_active":"2024-03-08T21:33:49.337051+0000","last_became_peered":"2024-03-08T21:33:49.337051+0000","last_unstale":"2024-03-08T21:33:49.342342+0000","last_undegraded":"2024-03-08T21:33:49.342342+0000","last_fullsized":"2024-03-08T21:33:49.342342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328788+0000","last_change":"2024-03-08T21:33:48.319889+0000","last_active":"2024-03-08T21:33:50.328788+0000","last_peered":"2024-03-08T21:33:50.328788+0000","last_clean":"2024-03-08T21:33:50.328788+0000","last_became_active":"2024-03-08T21:33:48.319630+0000","last_became_peered":"2024-03-08T21:33:48.319630+0000","last_unstale":"2024-03-08T21:33:50.328788+0000","last_undegraded":"2024-03-08T21:33:50.328788+0000","last_fullsized":"2024-03-08T21:33:50.328788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352007+0000","last_change":"2024-03-08T21:33:49.345172+0000","last_active":"2024-03-08T21:33:49.352007+0000","last_peered":"2024-03-08T21:33:49.352007+0000","last_clean":"2024-03-08T21:33:49.352007+0000","last_became_active":"2024-03-08T21:33:49.344744+0000","last_became_peered":"2024-03-08T21:33:49.344744+0000","last_unstale":"2024-03-08T21:33:49.352007+0000","last_undegraded":"2024-03-08T21:33:49.352007+0000","last_fullsized":"2024-03-08T21:33:49.352007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328849+0000","last_change":"2024-03-08T21:33:48.324914+0000","last_active":"2024-03-08T21:33:50.328849+0000","last_peered":"2024-03-08T21:33:50.328849+0000","last_clean":"2024-03-08T21:33:50.328849+0000","last_became_active":"2024-03-08T21:33:48.324729+0000","last_became_peered":"2024-03-08T21:33:48.324729+0000","last_unstale":"2024-03-08T21:33:50.328849+0000","last_undegraded":"2024-03-08T21:33:50.328849+0000","last_fullsized":"2024-03-08T21:33:50.328849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.350737+0000","last_change":"2024-03-08T21:33:49.343068+0000","last_active":"2024-03-08T21:33:49.350737+0000","last_peered":"2024-03-08T21:33:49.350737+0000","last_clean":"2024-03-08T21:33:49.350737+0000","last_became_active":"2024-03-08T21:33:49.342769+0000","last_became_peered":"2024-03-08T21:33:49.342769+0000","last_unstale":"2024-03-08T21:33:49.350737+0000","last_undegraded":"2024-03-08T21:33:49.350737+0000","last_fullsized":"2024-03-08T21:33:49.350737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313256+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:33:49.313256+0000","last_peered":"2024-03-08T21:33:49.313256+0000","last_clean":"2024-03-08T21:33:49.313256+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:33:49.313256+0000","last_undegraded":"2024-03-08T21:33:49.313256+0000","last_fullsized":"2024-03-08T21:33:49.313256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325470+0000","last_change":"2024-03-08T21:33:48.322277+0000","last_active":"2024-03-08T21:33:49.325470+0000","last_peered":"2024-03-08T21:33:49.325470+0000","last_clean":"2024-03-08T21:33:49.325470+0000","last_became_active":"2024-03-08T21:33:48.321924+0000","last_became_peered":"2024-03-08T21:33:48.321924+0000","last_unstale":"2024-03-08T21:33:49.325470+0000","last_undegraded":"2024-03-08T21:33:49.325470+0000","last_fullsized":"2024-03-08T21:33:49.325470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343566+0000","last_change":"2024-03-08T21:33:49.336954+0000","last_active":"2024-03-08T21:33:49.343566+0000","last_peered":"2024-03-08T21:33:49.343566+0000","last_clean":"2024-03-08T21:33:49.343566+0000","last_became_active":"2024-03-08T21:33:49.336698+0000","last_became_peered":"2024-03-08T21:33:49.336698+0000","last_unstale":"2024-03-08T21:33:49.343566+0000","last_undegraded":"2024-03-08T21:33:49.343566+0000","last_fullsized":"2024-03-08T21:33:49.343566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313197+0000","last_change":"2024-03-08T21:33:48.324162+0000","last_active":"2024-03-08T21:33:49.313197+0000","last_peered":"2024-03-08T21:33:49.313197+0000","last_clean":"2024-03-08T21:33:49.313197+0000","last_became_active":"2024-03-08T21:33:48.323370+0000","last_became_peered":"2024-03-08T21:33:48.323370+0000","last_unstale":"2024-03-08T21:33:49.313197+0000","last_undegraded":"2024-03-08T21:33:49.313197+0000","last_fullsized":"2024-03-08T21:33:49.313197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346947+0000","last_change":"2024-03-08T21:33:49.335670+0000","last_active":"2024-03-08T21:33:49.346947+0000","last_peered":"2024-03-08T21:33:49.346947+0000","last_clean":"2024-03-08T21:33:49.346947+0000","last_became_active":"2024-03-08T21:33:49.335420+0000","last_became_peered":"2024-03-08T21:33:49.335420+0000","last_unstale":"2024-03-08T21:33:49.346947+0000","last_undegraded":"2024-03-08T21:33:49.346947+0000","last_fullsized":"2024-03-08T21:33:49.346947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:39.246275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328196+0000","last_change":"2024-03-08T21:33:48.304590+0000","last_active":"2024-03-08T21:33:50.328196+0000","last_peered":"2024-03-08T21:33:50.328196+0000","last_clean":"2024-03-08T21:33:50.328196+0000","last_became_active":"2024-03-08T21:33:48.304130+0000","last_became_peered":"2024-03-08T21:33:48.304130+0000","last_unstale":"2024-03-08T21:33:50.328196+0000","last_undegraded":"2024-03-08T21:33:50.328196+0000","last_fullsized":"2024-03-08T21:33:50.328196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.339223+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.338871+0000","last_became_peered":"2024-03-08T21:33:49.338871+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325339+0000","last_change":"2024-03-08T21:33:48.322438+0000","last_active":"2024-03-08T21:33:49.325339+0000","last_peered":"2024-03-08T21:33:49.325339+0000","last_clean":"2024-03-08T21:33:49.325339+0000","last_became_active":"2024-03-08T21:33:48.322161+0000","last_became_peered":"2024-03-08T21:33:48.322161+0000","last_unstale":"2024-03-08T21:33:49.325339+0000","last_undegraded":"2024-03-08T21:33:49.325339+0000","last_fullsized":"2024-03-08T21:33:49.325339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.331077+0000","last_change":"2024-03-08T21:33:49.323865+0000","last_active":"2024-03-08T21:33:49.331077+0000","last_peered":"2024-03-08T21:33:49.331077+0000","last_clean":"2024-03-08T21:33:49.331077+0000","last_became_active":"2024-03-08T21:33:49.323330+0000","last_became_peered":"2024-03-08T21:33:49.323330+0000","last_unstale":"2024-03-08T21:33:49.331077+0000","last_undegraded":"2024-03-08T21:33:49.331077+0000","last_fullsized":"2024-03-08T21:33:49.331077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:51.979694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328384+0000","last_change":"2024-03-08T21:33:48.317519+0000","last_active":"2024-03-08T21:33:50.328384+0000","last_peered":"2024-03-08T21:33:50.328384+0000","last_clean":"2024-03-08T21:33:50.328384+0000","last_became_active":"2024-03-08T21:33:48.317260+0000","last_became_peered":"2024-03-08T21:33:48.317260+0000","last_unstale":"2024-03-08T21:33:50.328384+0000","last_undegraded":"2024-03-08T21:33:50.328384+0000","last_fullsized":"2024-03-08T21:33:50.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346771+0000","last_change":"2024-03-08T21:33:49.343487+0000","last_active":"2024-03-08T21:33:49.346771+0000","last_peered":"2024-03-08T21:33:49.346771+0000","last_clean":"2024-03-08T21:33:49.346771+0000","last_became_active":"2024-03-08T21:33:49.343231+0000","last_became_peered":"2024-03-08T21:33:49.343231+0000","last_unstale":"2024-03-08T21:33:49.346771+0000","last_undegraded":"2024-03-08T21:33:49.346771+0000","last_fullsized":"2024-03-08T21:33:49.346771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:19.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.317471+0000","last_change":"2024-03-08T21:33:48.320355+0000","last_active":"2024-03-08T21:33:49.317471+0000","last_peered":"2024-03-08T21:33:49.317471+0000","last_clean":"2024-03-08T21:33:49.317471+0000","last_became_active":"2024-03-08T21:33:48.320045+0000","last_became_peered":"2024-03-08T21:33:48.320045+0000","last_unstale":"2024-03-08T21:33:49.317471+0000","last_undegraded":"2024-03-08T21:33:49.317471+0000","last_fullsized":"2024-03-08T21:33:49.317471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328590+0000","last_change":"2024-03-08T21:33:49.335152+0000","last_active":"2024-03-08T21:33:50.328590+0000","last_peered":"2024-03-08T21:33:50.328590+0000","last_clean":"2024-03-08T21:33:50.328590+0000","last_became_active":"2024-03-08T21:33:49.334899+0000","last_became_peered":"2024-03-08T21:33:49.334899+0000","last_unstale":"2024-03-08T21:33:50.328590+0000","last_undegraded":"2024-03-08T21:33:50.328590+0000","last_fullsized":"2024-03-08T21:33:50.328590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.334653+0000","last_change":"2024-03-08T21:33:48.321898+0000","last_active":"2024-03-08T21:33:50.334653+0000","last_peered":"2024-03-08T21:33:50.334653+0000","last_clean":"2024-03-08T21:33:50.334653+0000","last_became_active":"2024-03-08T21:33:48.321538+0000","last_became_peered":"2024-03-08T21:33:48.321538+0000","last_unstale":"2024-03-08T21:33:50.334653+0000","last_undegraded":"2024-03-08T21:33:50.334653+0000","last_fullsized":"2024-03-08T21:33:50.334653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341992+0000","last_change":"2024-03-08T21:33:49.329726+0000","last_active":"2024-03-08T21:33:49.341992+0000","last_peered":"2024-03-08T21:33:49.341992+0000","last_clean":"2024-03-08T21:33:49.341992+0000","last_became_active":"2024-03-08T21:33:49.329391+0000","last_became_peered":"2024-03-08T21:33:49.329391+0000","last_unstale":"2024-03-08T21:33:49.341992+0000","last_undegraded":"2024-03-08T21:33:49.341992+0000","last_fullsized":"2024-03-08T21:33:49.341992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:55.992566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335670+0000","last_change":"2024-03-08T21:33:48.321998+0000","last_active":"2024-03-08T21:33:50.335670+0000","last_peered":"2024-03-08T21:33:50.335670+0000","last_clean":"2024-03-08T21:33:50.335670+0000","last_became_active":"2024-03-08T21:33:48.321277+0000","last_became_peered":"2024-03-08T21:33:48.321277+0000","last_unstale":"2024-03-08T21:33:50.335670+0000","last_undegraded":"2024-03-08T21:33:50.335670+0000","last_fullsized":"2024-03-08T21:33:50.335670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347053+0000","last_change":"2024-03-08T21:33:49.340131+0000","last_active":"2024-03-08T21:33:49.347053+0000","last_peered":"2024-03-08T21:33:49.347053+0000","last_clean":"2024-03-08T21:33:49.347053+0000","last_became_active":"2024-03-08T21:33:49.339816+0000","last_became_peered":"2024-03-08T21:33:49.339816+0000","last_unstale":"2024-03-08T21:33:49.347053+0000","last_undegraded":"2024-03-08T21:33:49.347053+0000","last_fullsized":"2024-03-08T21:33:49.347053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:52:43.691318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313029+0000","last_change":"2024-03-08T21:33:48.316829+0000","last_active":"2024-03-08T21:33:49.313029+0000","last_peered":"2024-03-08T21:33:49.313029+0000","last_clean":"2024-03-08T21:33:49.313029+0000","last_became_active":"2024-03-08T21:33:48.316647+0000","last_became_peered":"2024-03-08T21:33:48.316647+0000","last_unstale":"2024-03-08T21:33:49.313029+0000","last_undegraded":"2024-03-08T21:33:49.313029+0000","last_fullsized":"2024-03-08T21:33:49.313029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348302+0000","last_change":"2024-03-08T21:33:49.335879+0000","last_active":"2024-03-08T21:33:49.348302+0000","last_peered":"2024-03-08T21:33:49.348302+0000","last_clean":"2024-03-08T21:33:49.348302+0000","last_became_active":"2024-03-08T21:33:49.335555+0000","last_became_peered":"2024-03-08T21:33:49.335555+0000","last_unstale":"2024-03-08T21:33:49.348302+0000","last_undegraded":"2024-03-08T21:33:49.348302+0000","last_fullsized":"2024-03-08T21:33:49.348302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:18:40.361732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328130+0000","last_change":"2024-03-08T21:33:48.319210+0000","last_active":"2024-03-08T21:33:50.328130+0000","last_peered":"2024-03-08T21:33:50.328130+0000","last_clean":"2024-03-08T21:33:50.328130+0000","last_became_active":"2024-03-08T21:33:48.318910+0000","last_became_peered":"2024-03-08T21:33:48.318910+0000","last_unstale":"2024-03-08T21:33:50.328130+0000","last_undegraded":"2024-03-08T21:33:50.328130+0000","last_fullsized":"2024-03-08T21:33:50.328130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343614+0000","last_change":"2024-03-08T21:33:49.336542+0000","last_active":"2024-03-08T21:33:49.343614+0000","last_peered":"2024-03-08T21:33:49.343614+0000","last_clean":"2024-03-08T21:33:49.343614+0000","last_became_active":"2024-03-08T21:33:49.336243+0000","last_became_peered":"2024-03-08T21:33:49.336243+0000","last_unstale":"2024-03-08T21:33:49.343614+0000","last_undegraded":"2024-03-08T21:33:49.343614+0000","last_fullsized":"2024-03-08T21:33:49.343614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328488+0000","last_change":"2024-03-08T21:33:48.309925+0000","last_active":"2024-03-08T21:33:50.328488+0000","last_peered":"2024-03-08T21:33:50.328488+0000","last_clean":"2024-03-08T21:33:50.328488+0000","last_became_active":"2024-03-08T21:33:48.309536+0000","last_became_peered":"2024-03-08T21:33:48.309536+0000","last_unstale":"2024-03-08T21:33:50.328488+0000","last_undegraded":"2024-03-08T21:33:50.328488+0000","last_fullsized":"2024-03-08T21:33:50.328488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342296+0000","last_change":"2024-03-08T21:33:49.330871+0000","last_active":"2024-03-08T21:33:49.342296+0000","last_peered":"2024-03-08T21:33:49.342296+0000","last_clean":"2024-03-08T21:33:49.342296+0000","last_became_active":"2024-03-08T21:33:49.330561+0000","last_became_peered":"2024-03-08T21:33:49.330561+0000","last_unstale":"2024-03-08T21:33:49.342296+0000","last_undegraded":"2024-03-08T21:33:49.342296+0000","last_fullsized":"2024-03-08T21:33:49.342296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:35.410658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353639+0000","last_change":"2024-03-08T21:33:48.326317+0000","last_active":"2024-03-08T21:33:49.353639+0000","last_peered":"2024-03-08T21:33:49.353639+0000","last_clean":"2024-03-08T21:33:49.353639+0000","last_became_active":"2024-03-08T21:33:48.325057+0000","last_became_peered":"2024-03-08T21:33:48.325057+0000","last_unstale":"2024-03-08T21:33:49.353639+0000","last_undegraded":"2024-03-08T21:33:49.353639+0000","last_fullsized":"2024-03-08T21:33:49.353639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335298+0000","last_change":"2024-03-08T21:33:49.332013+0000","last_active":"2024-03-08T21:33:50.335298+0000","last_peered":"2024-03-08T21:33:50.335298+0000","last_clean":"2024-03-08T21:33:50.335298+0000","last_became_active":"2024-03-08T21:33:49.331755+0000","last_became_peered":"2024-03-08T21:33:49.331755+0000","last_unstale":"2024-03-08T21:33:50.335298+0000","last_undegraded":"2024-03-08T21:33:50.335298+0000","last_fullsized":"2024-03-08T21:33:50.335298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341626+0000","last_change":"2024-03-08T21:33:49.339645+0000","last_active":"2024-03-08T21:33:49.341626+0000","last_peered":"2024-03-08T21:33:49.341626+0000","last_clean":"2024-03-08T21:33:49.341626+0000","last_became_active":"2024-03-08T21:33:49.339017+0000","last_became_peered":"2024-03-08T21:33:49.339017+0000","last_unstale":"2024-03-08T21:33:49.341626+0000","last_undegraded":"2024-03-08T21:33:49.341626+0000","last_fullsized":"2024-03-08T21:33:49.341626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:08.991252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353888+0000","last_change":"2024-03-08T21:33:48.328103+0000","last_active":"2024-03-08T21:33:49.353888+0000","last_peered":"2024-03-08T21:33:49.353888+0000","last_clean":"2024-03-08T21:33:49.353888+0000","last_became_active":"2024-03-08T21:33:48.327722+0000","last_became_peered":"2024-03-08T21:33:48.327722+0000","last_unstale":"2024-03-08T21:33:49.353888+0000","last_undegraded":"2024-03-08T21:33:49.353888+0000","last_fullsized":"2024-03-08T21:33:49.353888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353542+0000","last_change":"2024-03-08T21:33:49.350219+0000","last_active":"2024-03-08T21:33:49.353542+0000","last_peered":"2024-03-08T21:33:49.353542+0000","last_clean":"2024-03-08T21:33:49.353542+0000","last_became_active":"2024-03-08T21:33:49.349972+0000","last_became_peered":"2024-03-08T21:33:49.349972+0000","last_unstale":"2024-03-08T21:33:49.353542+0000","last_undegraded":"2024-03-08T21:33:49.353542+0000","last_fullsized":"2024-03-08T21:33:49.353542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353059+0000","last_change":"2024-03-08T21:33:48.325856+0000","last_active":"2024-03-08T21:33:49.353059+0000","last_peered":"2024-03-08T21:33:49.353059+0000","last_clean":"2024-03-08T21:33:49.353059+0000","last_became_active":"2024-03-08T21:33:48.325490+0000","last_became_peered":"2024-03-08T21:33:48.325490+0000","last_unstale":"2024-03-08T21:33:49.353059+0000","last_undegraded":"2024-03-08T21:33:49.353059+0000","last_fullsized":"2024-03-08T21:33:49.353059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348565+0000","last_change":"2024-03-08T21:33:49.334099+0000","last_active":"2024-03-08T21:33:49.348565+0000","last_peered":"2024-03-08T21:33:49.348565+0000","last_clean":"2024-03-08T21:33:49.348565+0000","last_became_active":"2024-03-08T21:33:49.332877+0000","last_became_peered":"2024-03-08T21:33:49.332877+0000","last_unstale":"2024-03-08T21:33:49.348565+0000","last_undegraded":"2024-03-08T21:33:49.348565+0000","last_fullsized":"2024-03-08T21:33:49.348565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:18:40.361732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.356509+0000","last_change":"2024-03-08T21:33:48.313081+0000","last_active":"2024-03-08T21:33:49.356509+0000","last_peered":"2024-03-08T21:33:49.356509+0000","last_clean":"2024-03-08T21:33:49.356509+0000","last_became_active":"2024-03-08T21:33:48.312823+0000","last_became_peered":"2024-03-08T21:33:48.312823+0000","last_unstale":"2024-03-08T21:33:49.356509+0000","last_undegraded":"2024-03-08T21:33:49.356509+0000","last_fullsized":"2024-03-08T21:33:49.356509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342405+0000","last_change":"2024-03-08T21:33:49.330331+0000","last_active":"2024-03-08T21:33:49.342405+0000","last_peered":"2024-03-08T21:33:49.342405+0000","last_clean":"2024-03-08T21:33:49.342405+0000","last_became_active":"2024-03-08T21:33:49.330088+0000","last_became_peered":"2024-03-08T21:33:49.330088+0000","last_unstale":"2024-03-08T21:33:49.342405+0000","last_undegraded":"2024-03-08T21:33:49.342405+0000","last_fullsized":"2024-03-08T21:33:49.342405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:08.991252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.356145+0000","last_change":"2024-03-08T21:33:48.323630+0000","last_active":"2024-03-08T21:33:49.356145+0000","last_peered":"2024-03-08T21:33:49.356145+0000","last_clean":"2024-03-08T21:33:49.356145+0000","last_became_active":"2024-03-08T21:33:48.323342+0000","last_became_peered":"2024-03-08T21:33:48.323342+0000","last_unstale":"2024-03-08T21:33:49.356145+0000","last_undegraded":"2024-03-08T21:33:49.356145+0000","last_fullsized":"2024-03-08T21:33:49.356145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:50.973279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":656837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":65977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":65887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":59112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:33:53.414 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:33:53.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 Processor -- start 2024-03-08T21:33:53.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 -- start start 2024-03-08T21:33:53.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300726b0 0x7f8430072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84300b5990 0x7f843006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843006bb10 con 0x7f843013ed00 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843006e690 con 0x7f84300b5990 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f8436200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843006e970 con 0x7f84300726b0 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84300b5990 0x7f843006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f843013ed00 0x7f8430148290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50882/0 (socket says 172.21.15.119:50882) 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84300b5990 0x7f843006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43580/0 (socket says 172.21.15.119:43580) 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842fe00640 1 -- 172.21.15.119:0/765411519 learned_addr learned my addr 172.21.15.119:0/765411519 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842f400640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300726b0 0x7f8430072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 -- 172.21.15.119:0/765411519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300726b0 msgr2=0x7f8430072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300726b0 0x7f8430072a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 -- 172.21.15.119:0/765411519 >> v1:172.21.15.119:6789/0 conn(0x7f843013ed00 legacy=0x7f8430148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842ea00640 1 -- 172.21.15.119:0/765411519 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300b6ea0 con 0x7f84300b5990 2024-03-08T21:33:53.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.595+0000 7f842e000640 1 -- 172.21.15.119:0/765411519 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249640144 0 0) 0x7f843006bb10 con 0x7f843013ed00 2024-03-08T21:33:53.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f842ea00640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300b5990 0x7f843006b030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f841c0097c0 tx=0x7f841c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1644114d4607a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f842e000640 1 -- 172.21.15.119:0/765411519 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0ab430 con 0x7f84300b5990 2024-03-08T21:33:53.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f842e000640 1 -- 172.21.15.119:0/765411519 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c0b0070 con 0x7f84300b5990 2024-03-08T21:33:53.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f842e000640 1 -- 172.21.15.119:0/765411519 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0ab7f0 con 0x7f84300b5990 2024-03-08T21:33:53.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- 172.21.15.119:0/765411519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300b5990 msgr2=0x7f843006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300b5990 0x7f843006b030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f841c0097c0 tx=0x7f841c01c410 comp rx=0 tx=0).stop 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- 172.21.15.119:0/765411519 shutdown_connections 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300b5990 0x7f843006b030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 --2- 172.21.15.119:0/765411519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300726b0 0x7f8430072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- 172.21.15.119:0/765411519 >> 172.21.15.119:0/765411519 conn(0x7f84300b60c0 msgr2=0x7f84300b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- 172.21.15.119:0/765411519 shutdown_connections 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- 172.21.15.119:0/765411519 wait complete. 2024-03-08T21:33:53.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 Processor -- start 2024-03-08T21:33:53.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.599+0000 7f8436200640 1 -- start start 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300b5990 0x7f8430096c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f843013ed00 0x7f84301e1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301527c0 con 0x7f84300726b0 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430152640 con 0x7f843013ed00 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430152940 con 0x7f84300b5990 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43592/0 (socket says 172.21.15.119:43592) 2024-03-08T21:33:53.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 -- 172.21.15.119:0/1294751424 learned_addr learned my addr 172.21.15.119:0/1294751424 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842ea00640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300b5990 0x7f8430096c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842fe00640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f843013ed00 0x7f84301e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 -- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300b5990 msgr2=0x7f8430096c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300b5990 0x7f8430096c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 -- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f843013ed00 msgr2=0x7f84301e1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f843013ed00 0x7f84301e1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 -- 172.21.15.119:0/1294751424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430143ce0 con 0x7f84300726b0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f842f400640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f842000d5f0 tx=0x7f842000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200125f0 con 0x7f84300726b0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420019070 con 0x7f84300726b0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200129b0 con 0x7f84300726b0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843013fab0 con 0x7f84300726b0 2024-03-08T21:33:53.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843009b2e0 con 0x7f84300726b0 2024-03-08T21:33:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8430067db0 con 0x7f84300726b0 2024-03-08T21:33:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.603+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8420012b50 con 0x7f84300726b0 2024-03-08T21:33:53.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.607+0000 7f8427400640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 0x7f8410069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.607+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8420085c50 con 0x7f84300726b0 2024-03-08T21:33:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.607+0000 7f842ea00640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 0x7f8410069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.607+0000 7f842ea00640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 0x7f8410069b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f841c0af000 tx=0x7f841c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.611+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f84200568c0 con 0x7f84300726b0 2024-03-08T21:33:53.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.759+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f843009f6a0 con 0x7f8410067660 2024-03-08T21:33:53.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.767+0000 7f8427400640 1 -- 172.21.15.119:0/1294751424 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251896 (secure 0 0 0) 0x7f843009f6a0 con 0x7f8410067660 2024-03-08T21:33:53.758 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:53.759 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:33:53.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 msgr2=0x7f8410069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 0x7f8410069b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f841c0af000 tx=0x7f841c008040 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 msgr2=0x7f843009eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f842000d5f0 tx=0x7f842000dab0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 shutdown_connections 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8410067660 0x7f8410069b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f843013ed00 0x7f84301e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84300b5990 0x7f8430096c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 --2- 172.21.15.119:0/1294751424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84300726b0 0x7f843009eef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 >> 172.21.15.119:0/1294751424 conn(0x7f84300b60c0 msgr2=0x7f84300b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 shutdown_connections 2024-03-08T21:33:53.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.771+0000 7f8436200640 1 -- 172.21.15.119:0/1294751424 wait complete. 2024-03-08T21:33:53.777 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-08T21:33:52.416536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218880,"kb_used_data":2712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755840,"statfs":{"total":773094113280,"available":772869980160,"internally_reserved":0,"allocated":2777088,"data_stored":1698338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.129376"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342443+0000","last_change":"2024-03-08T21:33:49.338396+0000","last_active":"2024-03-08T21:33:49.342443+0000","last_peered":"2024-03-08T21:33:49.342443+0000","last_clean":"2024-03-08T21:33:49.342443+0000","last_became_active":"2024-03-08T21:33:49.336412+0000","last_became_peered":"2024-03-08T21:33:49.336412+0000","last_unstale":"2024-03-08T21:33:49.342443+0000","last_undegraded":"2024-03-08T21:33:49.342443+0000","last_fullsized":"2024-03-08T21:33:49.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328479+0000","last_change":"2024-03-08T21:33:49.346755+0000","last_active":"2024-03-08T21:33:50.328479+0000","last_peered":"2024-03-08T21:33:50.328479+0000","last_clean":"2024-03-08T21:33:50.328479+0000","last_became_active":"2024-03-08T21:33:49.345880+0000","last_became_peered":"2024-03-08T21:33:49.345880+0000","last_unstale":"2024-03-08T21:33:50.328479+0000","last_undegraded":"2024-03-08T21:33:50.328479+0000","last_fullsized":"2024-03-08T21:33:50.328479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355991+0000","last_change":"2024-03-08T21:33:49.352136+0000","last_active":"2024-03-08T21:33:49.355991+0000","last_peered":"2024-03-08T21:33:49.355991+0000","last_clean":"2024-03-08T21:33:49.355991+0000","last_became_active":"2024-03-08T21:33:49.351873+0000","last_became_peered":"2024-03-08T21:33:49.351873+0000","last_unstale":"2024-03-08T21:33:49.355991+0000","last_undegraded":"2024-03-08T21:33:49.355991+0000","last_fullsized":"2024-03-08T21:33:49.355991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:27:16.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352027+0000","last_change":"2024-03-08T21:33:49.345377+0000","last_active":"2024-03-08T21:33:49.352027+0000","last_peered":"2024-03-08T21:33:49.352027+0000","last_clean":"2024-03-08T21:33:49.352027+0000","last_became_active":"2024-03-08T21:33:49.344753+0000","last_became_peered":"2024-03-08T21:33:49.344753+0000","last_unstale":"2024-03-08T21:33:49.352027+0000","last_undegraded":"2024-03-08T21:33:49.352027+0000","last_fullsized":"2024-03-08T21:33:49.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341791+0000","last_change":"2024-03-08T21:33:49.335919+0000","last_active":"2024-03-08T21:33:49.341791+0000","last_peered":"2024-03-08T21:33:49.341791+0000","last_clean":"2024-03-08T21:33:49.341791+0000","last_became_active":"2024-03-08T21:33:49.335616+0000","last_became_peered":"2024-03-08T21:33:49.335616+0000","last_unstale":"2024-03-08T21:33:49.341791+0000","last_undegraded":"2024-03-08T21:33:49.341791+0000","last_fullsized":"2024-03-08T21:33:49.341791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352838+0000","last_change":"2024-03-08T21:33:49.349339+0000","last_active":"2024-03-08T21:33:49.352838+0000","last_peered":"2024-03-08T21:33:49.352838+0000","last_clean":"2024-03-08T21:33:49.352838+0000","last_became_active":"2024-03-08T21:33:49.348932+0000","last_became_peered":"2024-03-08T21:33:49.348932+0000","last_unstale":"2024-03-08T21:33:49.352838+0000","last_undegraded":"2024-03-08T21:33:49.352838+0000","last_fullsized":"2024-03-08T21:33:49.352838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341856+0000","last_change":"2024-03-08T21:33:49.327740+0000","last_active":"2024-03-08T21:33:49.341856+0000","last_peered":"2024-03-08T21:33:49.341856+0000","last_clean":"2024-03-08T21:33:49.341856+0000","last_became_active":"2024-03-08T21:33:49.327434+0000","last_became_peered":"2024-03-08T21:33:49.327434+0000","last_unstale":"2024-03-08T21:33:49.341856+0000","last_undegraded":"2024-03-08T21:33:49.341856+0000","last_fullsized":"2024-03-08T21:33:49.341856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343594+0000","last_change":"2024-03-08T21:33:49.336284+0000","last_active":"2024-03-08T21:33:49.343594+0000","last_peered":"2024-03-08T21:33:49.343594+0000","last_clean":"2024-03-08T21:33:49.343594+0000","last_became_active":"2024-03-08T21:33:49.335990+0000","last_became_peered":"2024-03-08T21:33:49.335990+0000","last_unstale":"2024-03-08T21:33:49.343594+0000","last_undegraded":"2024-03-08T21:33:49.343594+0000","last_fullsized":"2024-03-08T21:33:49.343594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:19.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342364+0000","last_change":"2024-03-08T21:33:49.337931+0000","last_active":"2024-03-08T21:33:49.342364+0000","last_peered":"2024-03-08T21:33:49.342364+0000","last_clean":"2024-03-08T21:33:49.342364+0000","last_became_active":"2024-03-08T21:33:49.337076+0000","last_became_peered":"2024-03-08T21:33:49.337076+0000","last_unstale":"2024-03-08T21:33:49.342364+0000","last_undegraded":"2024-03-08T21:33:49.342364+0000","last_fullsized":"2024-03-08T21:33:49.342364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335718+0000","last_change":"2024-03-08T21:33:49.334835+0000","last_active":"2024-03-08T21:33:50.335718+0000","last_peered":"2024-03-08T21:33:50.335718+0000","last_clean":"2024-03-08T21:33:50.335718+0000","last_became_active":"2024-03-08T21:33:49.334522+0000","last_became_peered":"2024-03-08T21:33:49.334522+0000","last_unstale":"2024-03-08T21:33:50.335718+0000","last_undegraded":"2024-03-08T21:33:50.335718+0000","last_fullsized":"2024-03-08T21:33:50.335718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335412+0000","last_change":"2024-03-08T21:33:49.340915+0000","last_active":"2024-03-08T21:33:50.335412+0000","last_peered":"2024-03-08T21:33:50.335412+0000","last_clean":"2024-03-08T21:33:50.335412+0000","last_became_active":"2024-03-08T21:33:49.340639+0000","last_became_peered":"2024-03-08T21:33:49.340639+0000","last_unstale":"2024-03-08T21:33:50.335412+0000","last_undegraded":"2024-03-08T21:33:50.335412+0000","last_fullsized":"2024-03-08T21:33:50.335412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348153+0000","last_change":"2024-03-08T21:33:49.332751+0000","last_active":"2024-03-08T21:33:49.348153+0000","last_peered":"2024-03-08T21:33:49.348153+0000","last_clean":"2024-03-08T21:33:49.348153+0000","last_became_active":"2024-03-08T21:33:49.332402+0000","last_became_peered":"2024-03-08T21:33:49.332402+0000","last_unstale":"2024-03-08T21:33:49.348153+0000","last_undegraded":"2024-03-08T21:33:49.348153+0000","last_fullsized":"2024-03-08T21:33:49.348153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:29:16.596294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342272+0000","last_change":"2024-03-08T21:33:49.330189+0000","last_active":"2024-03-08T21:33:49.342272+0000","last_peered":"2024-03-08T21:33:49.342272+0000","last_clean":"2024-03-08T21:33:49.342272+0000","last_became_active":"2024-03-08T21:33:49.327014+0000","last_became_peered":"2024-03-08T21:33:49.327014+0000","last_unstale":"2024-03-08T21:33:49.342272+0000","last_undegraded":"2024-03-08T21:33:49.342272+0000","last_fullsized":"2024-03-08T21:33:49.342272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:10.185170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347074+0000","last_change":"2024-03-08T21:33:49.341331+0000","last_active":"2024-03-08T21:33:49.347074+0000","last_peered":"2024-03-08T21:33:49.347074+0000","last_clean":"2024-03-08T21:33:49.347074+0000","last_became_active":"2024-03-08T21:33:49.341071+0000","last_became_peered":"2024-03-08T21:33:49.341071+0000","last_unstale":"2024-03-08T21:33:49.347074+0000","last_undegraded":"2024-03-08T21:33:49.347074+0000","last_fullsized":"2024-03-08T21:33:49.347074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:38.222178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328180+0000","last_change":"2024-03-08T21:33:49.333262+0000","last_active":"2024-03-08T21:33:50.328180+0000","last_peered":"2024-03-08T21:33:50.328180+0000","last_clean":"2024-03-08T21:33:50.328180+0000","last_became_active":"2024-03-08T21:33:49.332938+0000","last_became_peered":"2024-03-08T21:33:49.332938+0000","last_unstale":"2024-03-08T21:33:50.328180+0000","last_undegraded":"2024-03-08T21:33:50.328180+0000","last_fullsized":"2024-03-08T21:33:50.328180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353018+0000","last_change":"2024-03-08T21:33:49.349412+0000","last_active":"2024-03-08T21:33:49.353018+0000","last_peered":"2024-03-08T21:33:49.353018+0000","last_clean":"2024-03-08T21:33:49.353018+0000","last_became_active":"2024-03-08T21:33:49.349101+0000","last_became_peered":"2024-03-08T21:33:49.349101+0000","last_unstale":"2024-03-08T21:33:49.353018+0000","last_undegraded":"2024-03-08T21:33:49.353018+0000","last_fullsized":"2024-03-08T21:33:49.353018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352187+0000","last_change":"2024-03-08T21:33:49.345737+0000","last_active":"2024-03-08T21:33:49.352187+0000","last_peered":"2024-03-08T21:33:49.352187+0000","last_clean":"2024-03-08T21:33:49.352187+0000","last_became_active":"2024-03-08T21:33:49.345326+0000","last_became_peered":"2024-03-08T21:33:49.345326+0000","last_unstale":"2024-03-08T21:33:49.352187+0000","last_undegraded":"2024-03-08T21:33:49.352187+0000","last_fullsized":"2024-03-08T21:33:49.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328855+0000","last_change":"2024-03-08T21:33:49.341768+0000","last_active":"2024-03-08T21:33:50.328855+0000","last_peered":"2024-03-08T21:33:50.328855+0000","last_clean":"2024-03-08T21:33:50.328855+0000","last_became_active":"2024-03-08T21:33:49.340834+0000","last_became_peered":"2024-03-08T21:33:49.340834+0000","last_unstale":"2024-03-08T21:33:50.328855+0000","last_undegraded":"2024-03-08T21:33:50.328855+0000","last_fullsized":"2024-03-08T21:33:50.328855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.354688+0000","last_change":"2024-03-08T21:33:49.351201+0000","last_active":"2024-03-08T21:33:49.354688+0000","last_peered":"2024-03-08T21:33:49.354688+0000","last_clean":"2024-03-08T21:33:49.354688+0000","last_became_active":"2024-03-08T21:33:49.350871+0000","last_became_peered":"2024-03-08T21:33:49.350871+0000","last_unstale":"2024-03-08T21:33:49.354688+0000","last_undegraded":"2024-03-08T21:33:49.354688+0000","last_fullsized":"2024-03-08T21:33:49.354688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335320+0000","last_change":"2024-03-08T21:33:49.333002+0000","last_active":"2024-03-08T21:33:50.335320+0000","last_peered":"2024-03-08T21:33:50.335320+0000","last_clean":"2024-03-08T21:33:50.335320+0000","last_became_active":"2024-03-08T21:33:49.332612+0000","last_became_peered":"2024-03-08T21:33:49.332612+0000","last_unstale":"2024-03-08T21:33:50.335320+0000","last_undegraded":"2024-03-08T21:33:50.335320+0000","last_fullsized":"2024-03-08T21:33:50.335320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.336081+0000","last_change":"2024-03-08T21:33:49.325558+0000","last_active":"2024-03-08T21:33:49.336081+0000","last_peered":"2024-03-08T21:33:49.336081+0000","last_clean":"2024-03-08T21:33:49.336081+0000","last_became_active":"2024-03-08T21:33:49.325207+0000","last_became_peered":"2024-03-08T21:33:49.325207+0000","last_unstale":"2024-03-08T21:33:49.336081+0000","last_undegraded":"2024-03-08T21:33:49.336081+0000","last_fullsized":"2024-03-08T21:33:49.336081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:29:16.596294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.351999+0000","last_change":"2024-03-08T21:33:49.345431+0000","last_active":"2024-03-08T21:33:49.351999+0000","last_peered":"2024-03-08T21:33:49.351999+0000","last_clean":"2024-03-08T21:33:49.351999+0000","last_became_active":"2024-03-08T21:33:49.344751+0000","last_became_peered":"2024-03-08T21:33:49.344751+0000","last_unstale":"2024-03-08T21:33:49.351999+0000","last_undegraded":"2024-03-08T21:33:49.351999+0000","last_fullsized":"2024-03-08T21:33:49.351999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342227+0000","last_change":"2024-03-08T21:33:49.329867+0000","last_active":"2024-03-08T21:33:49.342227+0000","last_peered":"2024-03-08T21:33:49.342227+0000","last_clean":"2024-03-08T21:33:49.342227+0000","last_became_active":"2024-03-08T21:33:49.329548+0000","last_became_peered":"2024-03-08T21:33:49.329548+0000","last_unstale":"2024-03-08T21:33:49.342227+0000","last_undegraded":"2024-03-08T21:33:49.342227+0000","last_fullsized":"2024-03-08T21:33:49.342227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:45.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346746+0000","last_change":"2024-03-08T21:33:49.343224+0000","last_active":"2024-03-08T21:33:49.346746+0000","last_peered":"2024-03-08T21:33:49.346746+0000","last_clean":"2024-03-08T21:33:49.346746+0000","last_became_active":"2024-03-08T21:33:49.342845+0000","last_became_peered":"2024-03-08T21:33:49.342845+0000","last_unstale":"2024-03-08T21:33:49.346746+0000","last_undegraded":"2024-03-08T21:33:49.346746+0000","last_fullsized":"2024-03-08T21:33:49.346746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:35.410658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343574+0000","last_change":"2024-03-08T21:33:49.338081+0000","last_active":"2024-03-08T21:33:49.343574+0000","last_peered":"2024-03-08T21:33:49.343574+0000","last_clean":"2024-03-08T21:33:49.343574+0000","last_became_active":"2024-03-08T21:33:49.337826+0000","last_became_peered":"2024-03-08T21:33:49.337826+0000","last_unstale":"2024-03-08T21:33:49.343574+0000","last_undegraded":"2024-03-08T21:33:49.343574+0000","last_fullsized":"2024-03-08T21:33:49.343574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335721+0000","last_change":"2024-03-08T21:33:49.343833+0000","last_active":"2024-03-08T21:33:50.335721+0000","last_peered":"2024-03-08T21:33:50.335721+0000","last_clean":"2024-03-08T21:33:50.335721+0000","last_became_active":"2024-03-08T21:33:49.342474+0000","last_became_peered":"2024-03-08T21:33:49.342474+0000","last_unstale":"2024-03-08T21:33:50.335721+0000","last_undegraded":"2024-03-08T21:33:50.335721+0000","last_fullsized":"2024-03-08T21:33:50.335721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328615+0000","last_change":"2024-03-08T21:33:49.344117+0000","last_active":"2024-03-08T21:33:50.328615+0000","last_peered":"2024-03-08T21:33:50.328615+0000","last_clean":"2024-03-08T21:33:50.328615+0000","last_became_active":"2024-03-08T21:33:49.343840+0000","last_became_peered":"2024-03-08T21:33:49.343840+0000","last_unstale":"2024-03-08T21:33:50.328615+0000","last_undegraded":"2024-03-08T21:33:50.328615+0000","last_fullsized":"2024-03-08T21:33:50.328615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343674+0000","last_change":"2024-03-08T21:33:49.338130+0000","last_active":"2024-03-08T21:33:49.343674+0000","last_peered":"2024-03-08T21:33:49.343674+0000","last_clean":"2024-03-08T21:33:49.343674+0000","last_became_active":"2024-03-08T21:33:49.337923+0000","last_became_peered":"2024-03-08T21:33:49.337923+0000","last_unstale":"2024-03-08T21:33:49.343674+0000","last_undegraded":"2024-03-08T21:33:49.343674+0000","last_fullsized":"2024-03-08T21:33:49.343674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347440+0000","last_change":"2024-03-08T21:33:49.338988+0000","last_active":"2024-03-08T21:33:49.347440+0000","last_peered":"2024-03-08T21:33:49.347440+0000","last_clean":"2024-03-08T21:33:49.347440+0000","last_became_active":"2024-03-08T21:33:49.338156+0000","last_became_peered":"2024-03-08T21:33:49.338156+0000","last_unstale":"2024-03-08T21:33:49.347440+0000","last_undegraded":"2024-03-08T21:33:49.347440+0000","last_fullsized":"2024-03-08T21:33:49.347440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:05:04.726067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352185+0000","last_change":"2024-03-08T21:33:49.345748+0000","last_active":"2024-03-08T21:33:49.352185+0000","last_peered":"2024-03-08T21:33:49.352185+0000","last_clean":"2024-03-08T21:33:49.352185+0000","last_became_active":"2024-03-08T21:33:49.345428+0000","last_became_peered":"2024-03-08T21:33:49.345428+0000","last_unstale":"2024-03-08T21:33:49.352185+0000","last_undegraded":"2024-03-08T21:33:49.352185+0000","last_fullsized":"2024-03-08T21:33:49.352185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328975+0000","last_change":"2024-03-08T21:33:49.338873+0000","last_active":"2024-03-08T21:33:50.328975+0000","last_peered":"2024-03-08T21:33:50.328975+0000","last_clean":"2024-03-08T21:33:50.328975+0000","last_became_active":"2024-03-08T21:33:49.338055+0000","last_became_peered":"2024-03-08T21:33:49.338055+0000","last_unstale":"2024-03-08T21:33:50.328975+0000","last_undegraded":"2024-03-08T21:33:50.328975+0000","last_fullsized":"2024-03-08T21:33:50.328975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335228+0000","last_change":"2024-03-08T21:33:49.326802+0000","last_active":"2024-03-08T21:33:50.335228+0000","last_peered":"2024-03-08T21:33:50.335228+0000","last_clean":"2024-03-08T21:33:50.335228+0000","last_became_active":"2024-03-08T21:33:49.326507+0000","last_became_peered":"2024-03-08T21:33:49.326507+0000","last_unstale":"2024-03-08T21:33:50.335228+0000","last_undegraded":"2024-03-08T21:33:50.335228+0000","last_fullsized":"2024-03-08T21:33:50.335228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348111+0000","last_change":"2024-03-08T21:33:49.332694+0000","last_active":"2024-03-08T21:33:49.348111+0000","last_peered":"2024-03-08T21:33:49.348111+0000","last_clean":"2024-03-08T21:33:49.348111+0000","last_became_active":"2024-03-08T21:33:49.332330+0000","last_became_peered":"2024-03-08T21:33:49.332330+0000","last_unstale":"2024-03-08T21:33:49.348111+0000","last_undegraded":"2024-03-08T21:33:49.348111+0000","last_fullsized":"2024-03-08T21:33:49.348111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:00:35.543798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355728+0000","last_change":"2024-03-08T21:33:48.318511+0000","last_active":"2024-03-08T21:33:49.355728+0000","last_peered":"2024-03-08T21:33:49.355728+0000","last_clean":"2024-03-08T21:33:49.355728+0000","last_became_active":"2024-03-08T21:33:48.318248+0000","last_became_peered":"2024-03-08T21:33:48.318248+0000","last_unstale":"2024-03-08T21:33:49.355728+0000","last_undegraded":"2024-03-08T21:33:49.355728+0000","last_fullsized":"2024-03-08T21:33:49.355728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:41.855784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347419+0000","last_change":"2024-03-08T21:33:49.336639+0000","last_active":"2024-03-08T21:33:49.347419+0000","last_peered":"2024-03-08T21:33:49.347419+0000","last_clean":"2024-03-08T21:33:49.347419+0000","last_became_active":"2024-03-08T21:33:49.336391+0000","last_became_peered":"2024-03-08T21:33:49.336391+0000","last_unstale":"2024-03-08T21:33:49.347419+0000","last_undegraded":"2024-03-08T21:33:49.347419+0000","last_fullsized":"2024-03-08T21:33:49.347419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:15:32.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335233+0000","last_change":"2024-03-08T21:33:48.319438+0000","last_active":"2024-03-08T21:33:50.335233+0000","last_peered":"2024-03-08T21:33:50.335233+0000","last_clean":"2024-03-08T21:33:50.335233+0000","last_became_active":"2024-03-08T21:33:48.319140+0000","last_became_peered":"2024-03-08T21:33:48.319140+0000","last_unstale":"2024-03-08T21:33:50.335233+0000","last_undegraded":"2024-03-08T21:33:50.335233+0000","last_fullsized":"2024-03-08T21:33:50.335233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.323841+0000","last_change":"2024-03-08T21:33:48.320554+0000","last_active":"2024-03-08T21:33:49.323841+0000","last_peered":"2024-03-08T21:33:49.323841+0000","last_clean":"2024-03-08T21:33:49.323841+0000","last_became_active":"2024-03-08T21:33:48.320236+0000","last_became_peered":"2024-03-08T21:33:48.320236+0000","last_unstale":"2024-03-08T21:33:49.323841+0000","last_undegraded":"2024-03-08T21:33:49.323841+0000","last_fullsized":"2024-03-08T21:33:49.323841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:54.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342051+0000","last_change":"2024-03-08T21:33:49.329537+0000","last_active":"2024-03-08T21:33:49.342051+0000","last_peered":"2024-03-08T21:33:49.342051+0000","last_clean":"2024-03-08T21:33:49.342051+0000","last_became_active":"2024-03-08T21:33:49.329235+0000","last_became_peered":"2024-03-08T21:33:49.329235+0000","last_unstale":"2024-03-08T21:33:49.342051+0000","last_undegraded":"2024-03-08T21:33:49.342051+0000","last_fullsized":"2024-03-08T21:33:49.342051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:34.548585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.332165+0000","last_change":"2024-03-08T21:33:48.320328+0000","last_active":"2024-03-08T21:33:49.332165+0000","last_peered":"2024-03-08T21:33:49.332165+0000","last_clean":"2024-03-08T21:33:49.332165+0000","last_became_active":"2024-03-08T21:33:48.319881+0000","last_became_peered":"2024-03-08T21:33:48.319881+0000","last_unstale":"2024-03-08T21:33:49.332165+0000","last_undegraded":"2024-03-08T21:33:49.332165+0000","last_fullsized":"2024-03-08T21:33:49.332165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.344229+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.343942+0000","last_became_peered":"2024-03-08T21:33:49.343942+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335604+0000","last_change":"2024-03-08T21:33:48.331439+0000","last_active":"2024-03-08T21:33:50.335604+0000","last_peered":"2024-03-08T21:33:50.335604+0000","last_clean":"2024-03-08T21:33:50.335604+0000","last_became_active":"2024-03-08T21:33:48.331088+0000","last_became_peered":"2024-03-08T21:33:48.331088+0000","last_unstale":"2024-03-08T21:33:50.335604+0000","last_undegraded":"2024-03-08T21:33:50.335604+0000","last_fullsized":"2024-03-08T21:33:50.335604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.351733+0000","last_change":"2024-03-08T21:33:49.345091+0000","last_active":"2024-03-08T21:33:49.351733+0000","last_peered":"2024-03-08T21:33:49.351733+0000","last_clean":"2024-03-08T21:33:49.351733+0000","last_became_active":"2024-03-08T21:33:49.344796+0000","last_became_peered":"2024-03-08T21:33:49.344796+0000","last_unstale":"2024-03-08T21:33:49.351733+0000","last_undegraded":"2024-03-08T21:33:49.351733+0000","last_fullsized":"2024-03-08T21:33:49.351733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.329385+0000","last_change":"2024-03-08T21:33:48.336669+0000","last_active":"2024-03-08T21:33:49.329385+0000","last_peered":"2024-03-08T21:33:49.329385+0000","last_clean":"2024-03-08T21:33:49.329385+0000","last_became_active":"2024-03-08T21:33:48.336403+0000","last_became_peered":"2024-03-08T21:33:48.336403+0000","last_unstale":"2024-03-08T21:33:49.329385+0000","last_undegraded":"2024-03-08T21:33:49.329385+0000","last_fullsized":"2024-03-08T21:33:49.329385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348587+0000","last_change":"2024-03-08T21:33:49.339581+0000","last_active":"2024-03-08T21:33:49.348587+0000","last_peered":"2024-03-08T21:33:49.348587+0000","last_clean":"2024-03-08T21:33:49.348587+0000","last_became_active":"2024-03-08T21:33:49.332498+0000","last_became_peered":"2024-03-08T21:33:49.332498+0000","last_unstale":"2024-03-08T21:33:49.348587+0000","last_undegraded":"2024-03-08T21:33:49.348587+0000","last_fullsized":"2024-03-08T21:33:49.348587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:58.416650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328697+0000","last_change":"2024-03-08T21:33:48.326093+0000","last_active":"2024-03-08T21:33:50.328697+0000","last_peered":"2024-03-08T21:33:50.328697+0000","last_clean":"2024-03-08T21:33:50.328697+0000","last_became_active":"2024-03-08T21:33:48.325836+0000","last_became_peered":"2024-03-08T21:33:48.325836+0000","last_unstale":"2024-03-08T21:33:50.328697+0000","last_undegraded":"2024-03-08T21:33:50.328697+0000","last_fullsized":"2024-03-08T21:33:50.328697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.327423+0000","last_change":"2024-03-08T21:33:49.321155+0000","last_active":"2024-03-08T21:33:49.327423+0000","last_peered":"2024-03-08T21:33:49.327423+0000","last_clean":"2024-03-08T21:33:49.327423+0000","last_became_active":"2024-03-08T21:33:49.320883+0000","last_became_peered":"2024-03-08T21:33:49.320883+0000","last_unstale":"2024-03-08T21:33:49.327423+0000","last_undegraded":"2024-03-08T21:33:49.327423+0000","last_fullsized":"2024-03-08T21:33:49.327423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:10.650940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335352+0000","last_change":"2024-03-08T21:33:48.311111+0000","last_active":"2024-03-08T21:33:50.335352+0000","last_peered":"2024-03-08T21:33:50.335352+0000","last_clean":"2024-03-08T21:33:50.335352+0000","last_became_active":"2024-03-08T21:33:48.310608+0000","last_became_peered":"2024-03-08T21:33:48.310608+0000","last_unstale":"2024-03-08T21:33:50.335352+0000","last_undegraded":"2024-03-08T21:33:50.335352+0000","last_fullsized":"2024-03-08T21:33:50.335352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342953+0000","last_change":"2024-03-08T21:33:49.334300+0000","last_active":"2024-03-08T21:33:49.342953+0000","last_peered":"2024-03-08T21:33:49.342953+0000","last_clean":"2024-03-08T21:33:49.342953+0000","last_became_active":"2024-03-08T21:33:49.333906+0000","last_became_peered":"2024-03-08T21:33:49.333906+0000","last_unstale":"2024-03-08T21:33:49.342953+0000","last_undegraded":"2024-03-08T21:33:49.342953+0000","last_fullsized":"2024-03-08T21:33:49.342953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:57:30.014002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.355133+0000","last_change":"2024-03-08T21:33:48.316480+0000","last_active":"2024-03-08T21:33:49.355133+0000","last_peered":"2024-03-08T21:33:49.355133+0000","last_clean":"2024-03-08T21:33:49.355133+0000","last_became_active":"2024-03-08T21:33:48.316135+0000","last_became_peered":"2024-03-08T21:33:48.316135+0000","last_unstale":"2024-03-08T21:33:49.355133+0000","last_undegraded":"2024-03-08T21:33:49.355133+0000","last_fullsized":"2024-03-08T21:33:49.355133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:09.644526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.327113+0000","last_change":"2024-03-08T21:33:49.324801+0000","last_active":"2024-03-08T21:33:49.327113+0000","last_peered":"2024-03-08T21:33:49.327113+0000","last_clean":"2024-03-08T21:33:49.327113+0000","last_became_active":"2024-03-08T21:33:49.324523+0000","last_became_peered":"2024-03-08T21:33:49.324523+0000","last_unstale":"2024-03-08T21:33:49.327113+0000","last_undegraded":"2024-03-08T21:33:49.327113+0000","last_fullsized":"2024-03-08T21:33:49.327113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:00:35.543798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325256+0000","last_change":"2024-03-08T21:33:48.324724+0000","last_active":"2024-03-08T21:33:49.325256+0000","last_peered":"2024-03-08T21:33:49.325256+0000","last_clean":"2024-03-08T21:33:49.325256+0000","last_became_active":"2024-03-08T21:33:48.324379+0000","last_became_peered":"2024-03-08T21:33:48.324379+0000","last_unstale":"2024-03-08T21:33:49.325256+0000","last_undegraded":"2024-03-08T21:33:49.325256+0000","last_fullsized":"2024-03-08T21:33:49.325256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341722+0000","last_change":"2024-03-08T21:33:49.331839+0000","last_active":"2024-03-08T21:33:49.341722+0000","last_peered":"2024-03-08T21:33:49.341722+0000","last_clean":"2024-03-08T21:33:49.341722+0000","last_became_active":"2024-03-08T21:33:49.329912+0000","last_became_peered":"2024-03-08T21:33:49.329912+0000","last_unstale":"2024-03-08T21:33:49.341722+0000","last_undegraded":"2024-03-08T21:33:49.341722+0000","last_fullsized":"2024-03-08T21:33:49.341722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:54:48.328285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335165+0000","last_change":"2024-03-08T21:33:48.311849+0000","last_active":"2024-03-08T21:33:50.335165+0000","last_peered":"2024-03-08T21:33:50.335165+0000","last_clean":"2024-03-08T21:33:50.335165+0000","last_became_active":"2024-03-08T21:33:48.310917+0000","last_became_peered":"2024-03-08T21:33:48.310917+0000","last_unstale":"2024-03-08T21:33:50.335165+0000","last_undegraded":"2024-03-08T21:33:50.335165+0000","last_fullsized":"2024-03-08T21:33:50.335165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335308+0000","last_change":"2024-03-08T21:33:49.326937+0000","last_active":"2024-03-08T21:33:50.335308+0000","last_peered":"2024-03-08T21:33:50.335308+0000","last_clean":"2024-03-08T21:33:50.335308+0000","last_became_active":"2024-03-08T21:33:49.326518+0000","last_became_peered":"2024-03-08T21:33:49.326518+0000","last_unstale":"2024-03-08T21:33:50.335308+0000","last_undegraded":"2024-03-08T21:33:50.335308+0000","last_fullsized":"2024-03-08T21:33:50.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328078+0000","last_change":"2024-03-08T21:33:48.318497+0000","last_active":"2024-03-08T21:33:50.328078+0000","last_peered":"2024-03-08T21:33:50.328078+0000","last_clean":"2024-03-08T21:33:50.328078+0000","last_became_active":"2024-03-08T21:33:48.317867+0000","last_became_peered":"2024-03-08T21:33:48.317867+0000","last_unstale":"2024-03-08T21:33:50.328078+0000","last_undegraded":"2024-03-08T21:33:50.328078+0000","last_fullsized":"2024-03-08T21:33:50.328078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341884+0000","last_change":"2024-03-08T21:33:49.329322+0000","last_active":"2024-03-08T21:33:49.341884+0000","last_peered":"2024-03-08T21:33:49.341884+0000","last_clean":"2024-03-08T21:33:49.341884+0000","last_became_active":"2024-03-08T21:33:49.328970+0000","last_became_peered":"2024-03-08T21:33:49.328970+0000","last_unstale":"2024-03-08T21:33:49.341884+0000","last_undegraded":"2024-03-08T21:33:49.341884+0000","last_fullsized":"2024-03-08T21:33:49.341884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353531+0000","last_change":"2024-03-08T21:33:48.313918+0000","last_active":"2024-03-08T21:33:49.353531+0000","last_peered":"2024-03-08T21:33:49.353531+0000","last_clean":"2024-03-08T21:33:49.353531+0000","last_became_active":"2024-03-08T21:33:48.313623+0000","last_became_peered":"2024-03-08T21:33:48.313623+0000","last_unstale":"2024-03-08T21:33:49.353531+0000","last_undegraded":"2024-03-08T21:33:49.353531+0000","last_fullsized":"2024-03-08T21:33:49.353531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:12:02.322314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341965+0000","last_change":"2024-03-08T21:33:49.337361+0000","last_active":"2024-03-08T21:33:49.341965+0000","last_peered":"2024-03-08T21:33:49.341965+0000","last_clean":"2024-03-08T21:33:49.341965+0000","last_became_active":"2024-03-08T21:33:49.337028+0000","last_became_peered":"2024-03-08T21:33:49.337028+0000","last_unstale":"2024-03-08T21:33:49.341965+0000","last_undegraded":"2024-03-08T21:33:49.341965+0000","last_fullsized":"2024-03-08T21:33:49.341965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329029+0000","last_change":"2024-03-08T21:33:48.310802+0000","last_active":"2024-03-08T21:33:50.329029+0000","last_peered":"2024-03-08T21:33:50.329029+0000","last_clean":"2024-03-08T21:33:50.329029+0000","last_became_active":"2024-03-08T21:33:48.310508+0000","last_became_peered":"2024-03-08T21:33:48.310508+0000","last_unstale":"2024-03-08T21:33:50.329029+0000","last_undegraded":"2024-03-08T21:33:50.329029+0000","last_fullsized":"2024-03-08T21:33:50.329029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342342+0000","last_change":"2024-03-08T21:33:49.337562+0000","last_active":"2024-03-08T21:33:49.342342+0000","last_peered":"2024-03-08T21:33:49.342342+0000","last_clean":"2024-03-08T21:33:49.342342+0000","last_became_active":"2024-03-08T21:33:49.337051+0000","last_became_peered":"2024-03-08T21:33:49.337051+0000","last_unstale":"2024-03-08T21:33:49.342342+0000","last_undegraded":"2024-03-08T21:33:49.342342+0000","last_fullsized":"2024-03-08T21:33:49.342342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328788+0000","last_change":"2024-03-08T21:33:48.319889+0000","last_active":"2024-03-08T21:33:50.328788+0000","last_peered":"2024-03-08T21:33:50.328788+0000","last_clean":"2024-03-08T21:33:50.328788+0000","last_became_active":"2024-03-08T21:33:48.319630+0000","last_became_peered":"2024-03-08T21:33:48.319630+0000","last_unstale":"2024-03-08T21:33:50.328788+0000","last_undegraded":"2024-03-08T21:33:50.328788+0000","last_fullsized":"2024-03-08T21:33:50.328788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.352007+0000","last_change":"2024-03-08T21:33:49.345172+0000","last_active":"2024-03-08T21:33:49.352007+0000","last_peered":"2024-03-08T21:33:49.352007+0000","last_clean":"2024-03-08T21:33:49.352007+0000","last_became_active":"2024-03-08T21:33:49.344744+0000","last_became_peered":"2024-03-08T21:33:49.344744+0000","last_unstale":"2024-03-08T21:33:49.352007+0000","last_undegraded":"2024-03-08T21:33:49.352007+0000","last_fullsized":"2024-03-08T21:33:49.352007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328849+0000","last_change":"2024-03-08T21:33:48.324914+0000","last_active":"2024-03-08T21:33:50.328849+0000","last_peered":"2024-03-08T21:33:50.328849+0000","last_clean":"2024-03-08T21:33:50.328849+0000","last_became_active":"2024-03-08T21:33:48.324729+0000","last_became_peered":"2024-03-08T21:33:48.324729+0000","last_unstale":"2024-03-08T21:33:50.328849+0000","last_undegraded":"2024-03-08T21:33:50.328849+0000","last_fullsized":"2024-03-08T21:33:50.328849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.350737+0000","last_change":"2024-03-08T21:33:49.343068+0000","last_active":"2024-03-08T21:33:49.350737+0000","last_peered":"2024-03-08T21:33:49.350737+0000","last_clean":"2024-03-08T21:33:49.350737+0000","last_became_active":"2024-03-08T21:33:49.342769+0000","last_became_peered":"2024-03-08T21:33:49.342769+0000","last_unstale":"2024-03-08T21:33:49.350737+0000","last_undegraded":"2024-03-08T21:33:49.350737+0000","last_fullsized":"2024-03-08T21:33:49.350737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313256+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:33:49.313256+0000","last_peered":"2024-03-08T21:33:49.313256+0000","last_clean":"2024-03-08T21:33:49.313256+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:33:49.313256+0000","last_undegraded":"2024-03-08T21:33:49.313256+0000","last_fullsized":"2024-03-08T21:33:49.313256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325470+0000","last_change":"2024-03-08T21:33:48.322277+0000","last_active":"2024-03-08T21:33:49.325470+0000","last_peered":"2024-03-08T21:33:49.325470+0000","last_clean":"2024-03-08T21:33:49.325470+0000","last_became_active":"2024-03-08T21:33:48.321924+0000","last_became_peered":"2024-03-08T21:33:48.321924+0000","last_unstale":"2024-03-08T21:33:49.325470+0000","last_undegraded":"2024-03-08T21:33:49.325470+0000","last_fullsized":"2024-03-08T21:33:49.325470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343566+0000","last_change":"2024-03-08T21:33:49.336954+0000","last_active":"2024-03-08T21:33:49.343566+0000","last_peered":"2024-03-08T21:33:49.343566+0000","last_clean":"2024-03-08T21:33:49.343566+0000","last_became_active":"2024-03-08T21:33:49.336698+0000","last_became_peered":"2024-03-08T21:33:49.336698+0000","last_unstale":"2024-03-08T21:33:49.343566+0000","last_undegraded":"2024-03-08T21:33:49.343566+0000","last_fullsized":"2024-03-08T21:33:49.343566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313197+0000","last_change":"2024-03-08T21:33:48.324162+0000","last_active":"2024-03-08T21:33:49.313197+0000","last_peered":"2024-03-08T21:33:49.313197+0000","last_clean":"2024-03-08T21:33:49.313197+0000","last_became_active":"2024-03-08T21:33:48.323370+0000","last_became_peered":"2024-03-08T21:33:48.323370+0000","last_unstale":"2024-03-08T21:33:49.313197+0000","last_undegraded":"2024-03-08T21:33:49.313197+0000","last_fullsized":"2024-03-08T21:33:49.313197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346947+0000","last_change":"2024-03-08T21:33:49.335670+0000","last_active":"2024-03-08T21:33:49.346947+0000","last_peered":"2024-03-08T21:33:49.346947+0000","last_clean":"2024-03-08T21:33:49.346947+0000","last_became_active":"2024-03-08T21:33:49.335420+0000","last_became_peered":"2024-03-08T21:33:49.335420+0000","last_unstale":"2024-03-08T21:33:49.346947+0000","last_undegraded":"2024-03-08T21:33:49.346947+0000","last_fullsized":"2024-03-08T21:33:49.346947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:39.246275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328196+0000","last_change":"2024-03-08T21:33:48.304590+0000","last_active":"2024-03-08T21:33:50.328196+0000","last_peered":"2024-03-08T21:33:50.328196+0000","last_clean":"2024-03-08T21:33:50.328196+0000","last_became_active":"2024-03-08T21:33:48.304130+0000","last_became_peered":"2024-03-08T21:33:48.304130+0000","last_unstale":"2024-03-08T21:33:50.328196+0000","last_undegraded":"2024-03-08T21:33:50.328196+0000","last_fullsized":"2024-03-08T21:33:50.328196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.339223+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.338871+0000","last_became_peered":"2024-03-08T21:33:49.338871+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.325339+0000","last_change":"2024-03-08T21:33:48.322438+0000","last_active":"2024-03-08T21:33:49.325339+0000","last_peered":"2024-03-08T21:33:49.325339+0000","last_clean":"2024-03-08T21:33:49.325339+0000","last_became_active":"2024-03-08T21:33:48.322161+0000","last_became_peered":"2024-03-08T21:33:48.322161+0000","last_unstale":"2024-03-08T21:33:49.325339+0000","last_undegraded":"2024-03-08T21:33:49.325339+0000","last_fullsized":"2024-03-08T21:33:49.325339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.331077+0000","last_change":"2024-03-08T21:33:49.323865+0000","last_active":"2024-03-08T21:33:49.331077+0000","last_peered":"2024-03-08T21:33:49.331077+0000","last_clean":"2024-03-08T21:33:49.331077+0000","last_became_active":"2024-03-08T21:33:49.323330+0000","last_became_peered":"2024-03-08T21:33:49.323330+0000","last_unstale":"2024-03-08T21:33:49.331077+0000","last_undegraded":"2024-03-08T21:33:49.331077+0000","last_fullsized":"2024-03-08T21:33:49.331077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:51.979694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328384+0000","last_change":"2024-03-08T21:33:48.317519+0000","last_active":"2024-03-08T21:33:50.328384+0000","last_peered":"2024-03-08T21:33:50.328384+0000","last_clean":"2024-03-08T21:33:50.328384+0000","last_became_active":"2024-03-08T21:33:48.317260+0000","last_became_peered":"2024-03-08T21:33:48.317260+0000","last_unstale":"2024-03-08T21:33:50.328384+0000","last_undegraded":"2024-03-08T21:33:50.328384+0000","last_fullsized":"2024-03-08T21:33:50.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.346771+0000","last_change":"2024-03-08T21:33:49.343487+0000","last_active":"2024-03-08T21:33:49.346771+0000","last_peered":"2024-03-08T21:33:49.346771+0000","last_clean":"2024-03-08T21:33:49.346771+0000","last_became_active":"2024-03-08T21:33:49.343231+0000","last_became_peered":"2024-03-08T21:33:49.343231+0000","last_unstale":"2024-03-08T21:33:49.346771+0000","last_undegraded":"2024-03-08T21:33:49.346771+0000","last_fullsized":"2024-03-08T21:33:49.346771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:19.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.317471+0000","last_change":"2024-03-08T21:33:48.320355+0000","last_active":"2024-03-08T21:33:49.317471+0000","last_peered":"2024-03-08T21:33:49.317471+0000","last_clean":"2024-03-08T21:33:49.317471+0000","last_became_active":"2024-03-08T21:33:48.320045+0000","last_became_peered":"2024-03-08T21:33:48.320045+0000","last_unstale":"2024-03-08T21:33:49.317471+0000","last_undegraded":"2024-03-08T21:33:49.317471+0000","last_fullsized":"2024-03-08T21:33:49.317471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328590+0000","last_change":"2024-03-08T21:33:49.335152+0000","last_active":"2024-03-08T21:33:50.328590+0000","last_peered":"2024-03-08T21:33:50.328590+0000","last_clean":"2024-03-08T21:33:50.328590+0000","last_became_active":"2024-03-08T21:33:49.334899+0000","last_became_peered":"2024-03-08T21:33:49.334899+0000","last_unstale":"2024-03-08T21:33:50.328590+0000","last_undegraded":"2024-03-08T21:33:50.328590+0000","last_fullsized":"2024-03-08T21:33:50.328590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.334653+0000","last_change":"2024-03-08T21:33:48.321898+0000","last_active":"2024-03-08T21:33:50.334653+0000","last_peered":"2024-03-08T21:33:50.334653+0000","last_clean":"2024-03-08T21:33:50.334653+0000","last_became_active":"2024-03-08T21:33:48.321538+0000","last_became_peered":"2024-03-08T21:33:48.321538+0000","last_unstale":"2024-03-08T21:33:50.334653+0000","last_undegraded":"2024-03-08T21:33:50.334653+0000","last_fullsized":"2024-03-08T21:33:50.334653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341992+0000","last_change":"2024-03-08T21:33:49.329726+0000","last_active":"2024-03-08T21:33:49.341992+0000","last_peered":"2024-03-08T21:33:49.341992+0000","last_clean":"2024-03-08T21:33:49.341992+0000","last_became_active":"2024-03-08T21:33:49.329391+0000","last_became_peered":"2024-03-08T21:33:49.329391+0000","last_unstale":"2024-03-08T21:33:49.341992+0000","last_undegraded":"2024-03-08T21:33:49.341992+0000","last_fullsized":"2024-03-08T21:33:49.341992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:55.992566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335670+0000","last_change":"2024-03-08T21:33:48.321998+0000","last_active":"2024-03-08T21:33:50.335670+0000","last_peered":"2024-03-08T21:33:50.335670+0000","last_clean":"2024-03-08T21:33:50.335670+0000","last_became_active":"2024-03-08T21:33:48.321277+0000","last_became_peered":"2024-03-08T21:33:48.321277+0000","last_unstale":"2024-03-08T21:33:50.335670+0000","last_undegraded":"2024-03-08T21:33:50.335670+0000","last_fullsized":"2024-03-08T21:33:50.335670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.347053+0000","last_change":"2024-03-08T21:33:49.340131+0000","last_active":"2024-03-08T21:33:49.347053+0000","last_peered":"2024-03-08T21:33:49.347053+0000","last_clean":"2024-03-08T21:33:49.347053+0000","last_became_active":"2024-03-08T21:33:49.339816+0000","last_became_peered":"2024-03-08T21:33:49.339816+0000","last_unstale":"2024-03-08T21:33:49.347053+0000","last_undegraded":"2024-03-08T21:33:49.347053+0000","last_fullsized":"2024-03-08T21:33:49.347053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:52:43.691318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.313029+0000","last_change":"2024-03-08T21:33:48.316829+0000","last_active":"2024-03-08T21:33:49.313029+0000","last_peered":"2024-03-08T21:33:49.313029+0000","last_clean":"2024-03-08T21:33:49.313029+0000","last_became_active":"2024-03-08T21:33:48.316647+0000","last_became_peered":"2024-03-08T21:33:48.316647+0000","last_unstale":"2024-03-08T21:33:49.313029+0000","last_undegraded":"2024-03-08T21:33:49.313029+0000","last_fullsized":"2024-03-08T21:33:49.313029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348302+0000","last_change":"2024-03-08T21:33:49.335879+0000","last_active":"2024-03-08T21:33:49.348302+0000","last_peered":"2024-03-08T21:33:49.348302+0000","last_clean":"2024-03-08T21:33:49.348302+0000","last_became_active":"2024-03-08T21:33:49.335555+0000","last_became_peered":"2024-03-08T21:33:49.335555+0000","last_unstale":"2024-03-08T21:33:49.348302+0000","last_undegraded":"2024-03-08T21:33:49.348302+0000","last_fullsized":"2024-03-08T21:33:49.348302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:18:40.361732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328130+0000","last_change":"2024-03-08T21:33:48.319210+0000","last_active":"2024-03-08T21:33:50.328130+0000","last_peered":"2024-03-08T21:33:50.328130+0000","last_clean":"2024-03-08T21:33:50.328130+0000","last_became_active":"2024-03-08T21:33:48.318910+0000","last_became_peered":"2024-03-08T21:33:48.318910+0000","last_unstale":"2024-03-08T21:33:50.328130+0000","last_undegraded":"2024-03-08T21:33:50.328130+0000","last_fullsized":"2024-03-08T21:33:50.328130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.343614+0000","last_change":"2024-03-08T21:33:49.336542+0000","last_active":"2024-03-08T21:33:49.343614+0000","last_peered":"2024-03-08T21:33:49.343614+0000","last_clean":"2024-03-08T21:33:49.343614+0000","last_became_active":"2024-03-08T21:33:49.336243+0000","last_became_peered":"2024-03-08T21:33:49.336243+0000","last_unstale":"2024-03-08T21:33:49.343614+0000","last_undegraded":"2024-03-08T21:33:49.343614+0000","last_fullsized":"2024-03-08T21:33:49.343614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328488+0000","last_change":"2024-03-08T21:33:48.309925+0000","last_active":"2024-03-08T21:33:50.328488+0000","last_peered":"2024-03-08T21:33:50.328488+0000","last_clean":"2024-03-08T21:33:50.328488+0000","last_became_active":"2024-03-08T21:33:48.309536+0000","last_became_peered":"2024-03-08T21:33:48.309536+0000","last_unstale":"2024-03-08T21:33:50.328488+0000","last_undegraded":"2024-03-08T21:33:50.328488+0000","last_fullsized":"2024-03-08T21:33:50.328488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342296+0000","last_change":"2024-03-08T21:33:49.330871+0000","last_active":"2024-03-08T21:33:49.342296+0000","last_peered":"2024-03-08T21:33:49.342296+0000","last_clean":"2024-03-08T21:33:49.342296+0000","last_became_active":"2024-03-08T21:33:49.330561+0000","last_became_peered":"2024-03-08T21:33:49.330561+0000","last_unstale":"2024-03-08T21:33:49.342296+0000","last_undegraded":"2024-03-08T21:33:49.342296+0000","last_fullsized":"2024-03-08T21:33:49.342296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:35.410658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353639+0000","last_change":"2024-03-08T21:33:48.326317+0000","last_active":"2024-03-08T21:33:49.353639+0000","last_peered":"2024-03-08T21:33:49.353639+0000","last_clean":"2024-03-08T21:33:49.353639+0000","last_became_active":"2024-03-08T21:33:48.325057+0000","last_became_peered":"2024-03-08T21:33:48.325057+0000","last_unstale":"2024-03-08T21:33:49.353639+0000","last_undegraded":"2024-03-08T21:33:49.353639+0000","last_fullsized":"2024-03-08T21:33:49.353639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335298+0000","last_change":"2024-03-08T21:33:49.332013+0000","last_active":"2024-03-08T21:33:50.335298+0000","last_peered":"2024-03-08T21:33:50.335298+0000","last_clean":"2024-03-08T21:33:50.335298+0000","last_became_active":"2024-03-08T21:33:49.331755+0000","last_became_peered":"2024-03-08T21:33:49.331755+0000","last_unstale":"2024-03-08T21:33:50.335298+0000","last_undegraded":"2024-03-08T21:33:50.335298+0000","last_fullsized":"2024-03-08T21:33:50.335298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.341626+0000","last_change":"2024-03-08T21:33:49.339645+0000","last_active":"2024-03-08T21:33:49.341626+0000","last_peered":"2024-03-08T21:33:49.341626+0000","last_clean":"2024-03-08T21:33:49.341626+0000","last_became_active":"2024-03-08T21:33:49.339017+0000","last_became_peered":"2024-03-08T21:33:49.339017+0000","last_unstale":"2024-03-08T21:33:49.341626+0000","last_undegraded":"2024-03-08T21:33:49.341626+0000","last_fullsized":"2024-03-08T21:33:49.341626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:08.991252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353888+0000","last_change":"2024-03-08T21:33:48.328103+0000","last_active":"2024-03-08T21:33:49.353888+0000","last_peered":"2024-03-08T21:33:49.353888+0000","last_clean":"2024-03-08T21:33:49.353888+0000","last_became_active":"2024-03-08T21:33:48.327722+0000","last_became_peered":"2024-03-08T21:33:48.327722+0000","last_unstale":"2024-03-08T21:33:49.353888+0000","last_undegraded":"2024-03-08T21:33:49.353888+0000","last_fullsized":"2024-03-08T21:33:49.353888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353542+0000","last_change":"2024-03-08T21:33:49.350219+0000","last_active":"2024-03-08T21:33:49.353542+0000","last_peered":"2024-03-08T21:33:49.353542+0000","last_clean":"2024-03-08T21:33:49.353542+0000","last_became_active":"2024-03-08T21:33:49.349972+0000","last_became_peered":"2024-03-08T21:33:49.349972+0000","last_unstale":"2024-03-08T21:33:49.353542+0000","last_undegraded":"2024-03-08T21:33:49.353542+0000","last_fullsized":"2024-03-08T21:33:49.353542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.353059+0000","last_change":"2024-03-08T21:33:48.325856+0000","last_active":"2024-03-08T21:33:49.353059+0000","last_peered":"2024-03-08T21:33:49.353059+0000","last_clean":"2024-03-08T21:33:49.353059+0000","last_became_active":"2024-03-08T21:33:48.325490+0000","last_became_peered":"2024-03-08T21:33:48.325490+0000","last_unstale":"2024-03-08T21:33:49.353059+0000","last_undegraded":"2024-03-08T21:33:49.353059+0000","last_fullsized":"2024-03-08T21:33:49.353059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.348565+0000","last_change":"2024-03-08T21:33:49.334099+0000","last_active":"2024-03-08T21:33:49.348565+0000","last_peered":"2024-03-08T21:33:49.348565+0000","last_clean":"2024-03-08T21:33:49.348565+0000","last_became_active":"2024-03-08T21:33:49.332877+0000","last_became_peered":"2024-03-08T21:33:49.332877+0000","last_unstale":"2024-03-08T21:33:49.348565+0000","last_undegraded":"2024-03-08T21:33:49.348565+0000","last_fullsized":"2024-03-08T21:33:49.348565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:18:40.361732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.356509+0000","last_change":"2024-03-08T21:33:48.313081+0000","last_active":"2024-03-08T21:33:49.356509+0000","last_peered":"2024-03-08T21:33:49.356509+0000","last_clean":"2024-03-08T21:33:49.356509+0000","last_became_active":"2024-03-08T21:33:48.312823+0000","last_became_peered":"2024-03-08T21:33:48.312823+0000","last_unstale":"2024-03-08T21:33:49.356509+0000","last_undegraded":"2024-03-08T21:33:49.356509+0000","last_fullsized":"2024-03-08T21:33:49.356509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.342405+0000","last_change":"2024-03-08T21:33:49.330331+0000","last_active":"2024-03-08T21:33:49.342405+0000","last_peered":"2024-03-08T21:33:49.342405+0000","last_clean":"2024-03-08T21:33:49.342405+0000","last_became_active":"2024-03-08T21:33:49.330088+0000","last_became_peered":"2024-03-08T21:33:49.330088+0000","last_unstale":"2024-03-08T21:33:49.342405+0000","last_undegraded":"2024-03-08T21:33:49.342405+0000","last_fullsized":"2024-03-08T21:33:49.342405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:08.991252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T21:33:49.356145+0000","last_change":"2024-03-08T21:33:48.323630+0000","last_active":"2024-03-08T21:33:49.356145+0000","last_peered":"2024-03-08T21:33:49.356145+0000","last_clean":"2024-03-08T21:33:49.356145+0000","last_became_active":"2024-03-08T21:33:48.323342+0000","last_became_peered":"2024-03-08T21:33:48.323342+0000","last_unstale":"2024-03-08T21:33:49.356145+0000","last_undegraded":"2024-03-08T21:33:49.356145+0000","last_fullsized":"2024-03-08T21:33:49.356145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:50.973279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":656837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":65977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":67499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":65887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":59112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":649480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:33:53.781 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-08T21:33:53.781 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-08T21:33:53.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-08T21:33:53.782 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-08T21:33:53.782 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-08T21:33:53.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 Processor -- start 2024-03-08T21:33:53.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 -- start start 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 0x7fce40140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fce400b6440 0x7fce401412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4006ddf0 con 0x7fce4006da10 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce400b6190 con 0x7fce400b6440 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce47400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400b4570 con 0x7fce400b5c70 2024-03-08T21:33:53.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce44a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fce4006da10 0x7fce400b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50894/0 (socket says 172.21.15.119:50894) 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce44a00640 1 -- 172.21.15.119:0/634824543 learned_addr learned my addr 172.21.15.119:0/634824543 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3fe00640 1 --2- 172.21.15.119:0/634824543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 0x7fce40140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce45400640 1 --2- 172.21.15.119:0/634824543 >> v2:172.21.15.160:3300/0 conn(0x7fce400b6440 0x7fce401412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3f400640 1 -- 172.21.15.119:0/634824543 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028554098 0 0) 0x7fce4006ddf0 con 0x7fce4006da10 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3f400640 1 -- 172.21.15.119:0/634824543 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce24003530 con 0x7fce4006da10 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3fe00640 1 -- 172.21.15.119:0/634824543 >> v2:172.21.15.160:3300/0 conn(0x7fce400b6440 msgr2=0x7fce401412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3fe00640 1 --2- 172.21.15.119:0/634824543 >> v2:172.21.15.160:3300/0 conn(0x7fce400b6440 0x7fce401412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3fe00640 1 -- 172.21.15.119:0/634824543 >> v1:172.21.15.119:6789/0 conn(0x7fce4006da10 legacy=0x7fce400b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.971+0000 7fce3fe00640 1 -- 172.21.15.119:0/634824543 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400b4850 con 0x7fce400b5c70 2024-03-08T21:33:53.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce3fe00640 1 --2- 172.21.15.119:0/634824543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 0x7fce40140d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0097c0 tx=0x7fce2c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d9a9c510ce50de server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce3f400640 1 -- 172.21.15.119:0/634824543 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0b0070 con 0x7fce400b5c70 2024-03-08T21:33:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce3f400640 1 -- 172.21.15.119:0/634824543 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0ab600 con 0x7fce400b5c70 2024-03-08T21:33:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce3f400640 1 -- 172.21.15.119:0/634824543 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ab9d0 con 0x7fce400b5c70 2024-03-08T21:33:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 -- 172.21.15.119:0/634824543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 msgr2=0x7fce40140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 --2- 172.21.15.119:0/634824543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 0x7fce40140d70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0097c0 tx=0x7fce2c01c410 comp rx=0 tx=0).stop 2024-03-08T21:33:53.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 -- 172.21.15.119:0/634824543 shutdown_connections 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 --2- 172.21.15.119:0/634824543 >> v2:172.21.15.160:3300/0 conn(0x7fce400b6440 0x7fce401412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 --2- 172.21.15.119:0/634824543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b5c70 0x7fce40140d70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 -- 172.21.15.119:0/634824543 >> 172.21.15.119:0/634824543 conn(0x7fce4006b6e0 msgr2=0x7fce400ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 -- 172.21.15.119:0/634824543 shutdown_connections 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.975+0000 7fce47400640 1 -- 172.21.15.119:0/634824543 wait complete. 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 Processor -- start 2024-03-08T21:33:53.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- start start 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce400b5c70 0x7fce401df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b6440 0x7fce401e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40154280 con 0x7fce4006da10 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce40154400 con 0x7fce400b5c70 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce40154580 con 0x7fce400b6440 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43606/0 (socket says 172.21.15.119:43606) 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 -- 172.21.15.119:0/3902402550 learned_addr learned my addr 172.21.15.119:0/3902402550 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce3fe00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce400b5c70 0x7fce401df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce45400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b6440 0x7fce401e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 -- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b6440 msgr2=0x7fce401e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b6440 0x7fce401e2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 -- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce400b5c70 msgr2=0x7fce401df6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce400b5c70 0x7fce401df6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 -- 172.21.15.119:0/3902402550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4013b4d0 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce44a00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce3000cad0 tx=0x7fce3000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30017070 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000ac30 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30012400 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4013b7b0 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce40139c40 con 0x7fce4006da10 2024-03-08T21:33:53.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.979+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce40067db0 con 0x7fce4006da10 2024-03-08T21:33:53.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.983+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fce3001a070 con 0x7fce4006da10 2024-03-08T21:33:53.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.983+0000 7fce3cc00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 0x7fce20069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:53.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.983+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce30085580 con 0x7fce4006da10 2024-03-08T21:33:53.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.983+0000 7fce3fe00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 0x7fce20069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:53.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.983+0000 7fce3fe00640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 0x7fce20069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ad000 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:53.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:53.987+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fce30055be0 con 0x7fce4006da10 2024-03-08T21:33:54.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.175+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fce4013a1a0 con 0x7fce4006da10 2024-03-08T21:33:54.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.179+0000 7fce3cc00640 1 -- 172.21.15.119:0/3902402550 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166533 (secure 0 0 0) 0x7fce30059c80 con 0x7fce4006da10 2024-03-08T21:33:54.167 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:54.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 msgr2=0x7fce20069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 0x7fce20069b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ad000 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 msgr2=0x7fce40144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce3000cad0 tx=0x7fce3000cf90 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 shutdown_connections 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce20067660 0x7fce20069b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce400b6440 0x7fce401e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce400b5c70 0x7fce401df6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 --2- 172.21.15.119:0/3902402550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce4006da10 0x7fce40144250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 >> 172.21.15.119:0/3902402550 conn(0x7fce4006b6e0 msgr2=0x7fce400720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 shutdown_connections 2024-03-08T21:33:54.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.183+0000 7fce47400640 1 -- 172.21.15.119:0/3902402550 wait complete. 2024-03-08T21:33:54.187 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":3371077572},{"type":"v1","addr":"172.21.15.119:6833","nonce":3371077572}]},"active_addr":"172.21.15.119:6833/3371077572","active_change":"2024-03-08T21:33:28.400492+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":958481648}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1592275860}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1111171686}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2046518650}]}]} 2024-03-08T21:33:54.191 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-08T21:33:54.191 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-08T21:33:54.191 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.339+0000 7f25c0e00640 1 Processor -- start 2024-03-08T21:33:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.339+0000 7f25c0e00640 1 -- start start 2024-03-08T21:33:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25c0e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 0x7f25bc09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25c0e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 0x7f25bc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25c0e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25bc09b190 con 0x7f25bc1446e0 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25c0e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc09d240 con 0x7f25bc072fe0 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25c0e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc09d520 con 0x7f25bc09adb0 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 0x7f25bc09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25ba800640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f25bc1446e0 0x7f25bc13d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:36964/0 (socket says 172.21.15.119:36964) 2024-03-08T21:33:54.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25ba800640 1 -- 172.21.15.119:0/204636937 learned_addr learned my addr 172.21.15.119:0/204636937 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9400640 1 --2- 172.21.15.119:0/204636937 >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 0x7f25bc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9e00640 1 -- 172.21.15.119:0/204636937 >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 msgr2=0x7f25bc1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9e00640 1 --2- 172.21.15.119:0/204636937 >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 0x7f25bc1441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9e00640 1 -- 172.21.15.119:0/204636937 >> v1:172.21.15.160:6789/0 conn(0x7f25bc1446e0 legacy=0x7f25bc13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9e00640 1 -- 172.21.15.119:0/204636937 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc144af0 con 0x7f25bc09adb0 2024-03-08T21:33:54.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.343+0000 7f25b9400640 1 --2- 172.21.15.119:0/204636937 >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 0x7f25bc1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b9e00640 1 --2- 172.21.15.119:0/204636937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 0x7f25bc09cbf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb92c5b2f3a147a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b8a00640 1 -- 172.21.15.119:0/204636937 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ab660 con 0x7f25bc09adb0 2024-03-08T21:33:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b8a00640 1 -- 172.21.15.119:0/204636937 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0b0070 con 0x7f25bc09adb0 2024-03-08T21:33:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b8a00640 1 -- 172.21.15.119:0/204636937 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0aba20 con 0x7f25bc09adb0 2024-03-08T21:33:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- 172.21.15.119:0/204636937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 msgr2=0x7f25bc09cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- 172.21.15.119:0/204636937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 0x7f25bc09cbf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0097c0 tx=0x7f25ac01c440 comp rx=0 tx=0).stop 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- 172.21.15.119:0/204636937 shutdown_connections 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- 172.21.15.119:0/204636937 >> v2:172.21.15.160:3300/0 conn(0x7f25bc072fe0 0x7f25bc1441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- 172.21.15.119:0/204636937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc09adb0 0x7f25bc09cbf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- 172.21.15.119:0/204636937 >> 172.21.15.119:0/204636937 conn(0x7f25bc06c620 msgr2=0x7f25bc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- 172.21.15.119:0/204636937 shutdown_connections 2024-03-08T21:33:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- 172.21.15.119:0/204636937 wait complete. 2024-03-08T21:33:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 Processor -- start 2024-03-08T21:33:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- start start 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc072fe0 0x7f25bc13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc1446e0 0x7f25bc140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc151180 con 0x7f25bc09adb0 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc151000 con 0x7f25bc1446e0 2024-03-08T21:33:54.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25c0e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc151300 con 0x7f25bc072fe0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b9400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b9400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43620/0 (socket says 172.21.15.119:43620) 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b9400640 1 -- 172.21.15.119:0/4063083154 learned_addr learned my addr 172.21.15.119:0/4063083154 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.347+0000 7f25b9e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc072fe0 0x7f25bc13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25ba800640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc1446e0 0x7f25bc140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 -- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc072fe0 msgr2=0x7f25bc13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc072fe0 0x7f25bc13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 -- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc1446e0 msgr2=0x7f25bc140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc1446e0 0x7f25bc140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 -- 172.21.15.119:0/4063083154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc13fcd0 con 0x7f25bc09adb0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b9400640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e9b0 tx=0x7f25a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8017070 con 0x7f25bc09adb0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800c9a0 con 0x7f25bc09adb0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800cd90 con 0x7f25bc09adb0 2024-03-08T21:33:54.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc13ffb0 con 0x7f25bc09adb0 2024-03-08T21:33:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc0b7930 con 0x7f25bc09adb0 2024-03-08T21:33:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc067db0 con 0x7f25bc09adb0 2024-03-08T21:33:54.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f25a801a070 con 0x7f25bc09adb0 2024-03-08T21:33:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 0x7f259c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.351+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a8085780 con 0x7f25bc09adb0 2024-03-08T21:33:54.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.355+0000 7f25b9e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 0x7f259c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.355+0000 7f25b9e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 0x7f259c069b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0af000 tx=0x7f25ac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.355+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f25a8055da0 con 0x7f25bc09adb0 2024-03-08T21:33:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.515+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25bc13bcb0 con 0x7f25bc09adb0 2024-03-08T21:33:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.515+0000 7f25b2000640 1 -- 172.21.15.119:0/4063083154 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f25a8059e40 con 0x7f25bc09adb0 2024-03-08T21:33:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:54.502 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:54.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 msgr2=0x7f259c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 0x7f259c069b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0af000 tx=0x7f25ac0a7000 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 msgr2=0x7f25bc13e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e9b0 tx=0x7f25a800ee70 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 shutdown_connections 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f259c067660 0x7f259c069b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc1446e0 0x7f25bc140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25bc09adb0 0x7f25bc13e9b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 --2- 172.21.15.119:0/4063083154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25bc072fe0 0x7f25bc13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 >> 172.21.15.119:0/4063083154 conn(0x7f25bc06c620 msgr2=0x7f25bc13a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 shutdown_connections 2024-03-08T21:33:54.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.519+0000 7f25c0e00640 1 -- 172.21.15.119:0/4063083154 wait complete. 2024-03-08T21:33:54.522 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-08T21:33:54.522 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:54.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 Processor -- start 2024-03-08T21:33:54.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 -- start start 2024-03-08T21:33:54.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f432c09adb0 0x7f432c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 0x7f432c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c09b190 con 0x7f432c1446e0 2024-03-08T21:33:54.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c09d240 con 0x7f432c09adb0 2024-03-08T21:33:54.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4331200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c09d520 con 0x7f432c072fe0 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4329e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f432c09adb0 0x7f432c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f432a800640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f432c1446e0 0x7f432c13d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:36966/0 (socket says 172.21.15.119:36966) 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f4321400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 0x7f432c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.671+0000 7f432a800640 1 -- 172.21.15.119:0/3808034819 learned_addr learned my addr 172.21.15.119:0/3808034819 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4321400640 1 -- 172.21.15.119:0/3808034819 >> v2:172.21.15.160:3300/0 conn(0x7f432c09adb0 msgr2=0x7f432c09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4321400640 1 --2- 172.21.15.119:0/3808034819 >> v2:172.21.15.160:3300/0 conn(0x7f432c09adb0 0x7f432c09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4329400640 1 -- 172.21.15.119:0/3808034819 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489619957 0 0) 0x7f432c09b190 con 0x7f432c1446e0 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4321400640 1 -- 172.21.15.119:0/3808034819 >> v1:172.21.15.160:6789/0 conn(0x7f432c1446e0 legacy=0x7f432c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4321400640 1 -- 172.21.15.119:0/3808034819 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c144af0 con 0x7f432c072fe0 2024-03-08T21:33:54.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4321400640 1 --2- 172.21.15.119:0/3808034819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 0x7f432c1441a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43140097c0 tx=0x7f431401e650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38a24986ea8a136a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4329400640 1 -- 172.21.15.119:0/3808034819 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140ab640 con 0x7f432c072fe0 2024-03-08T21:33:54.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4329400640 1 -- 172.21.15.119:0/3808034819 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43140ab7e0 con 0x7f432c072fe0 2024-03-08T21:33:54.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.675+0000 7f4329400640 1 -- 172.21.15.119:0/3808034819 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140abbb0 con 0x7f432c072fe0 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/3808034819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 msgr2=0x7f432c1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- 172.21.15.119:0/3808034819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 0x7f432c1441a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43140097c0 tx=0x7f431401e650 comp rx=0 tx=0).stop 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/3808034819 shutdown_connections 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- 172.21.15.119:0/3808034819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c072fe0 0x7f432c1441a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- 172.21.15.119:0/3808034819 >> v2:172.21.15.160:3300/0 conn(0x7f432c09adb0 0x7f432c09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/3808034819 >> 172.21.15.119:0/3808034819 conn(0x7f432c06c620 msgr2=0x7f432c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/3808034819 shutdown_connections 2024-03-08T21:33:54.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/3808034819 wait complete. 2024-03-08T21:33:54.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 Processor -- start 2024-03-08T21:33:54.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- start start 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c09adb0 0x7f432c13fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1446e0 0x7f432c140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c09a620 con 0x7f432c072fe0 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c09a4a0 con 0x7f432c1446e0 2024-03-08T21:33:54.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c09a7a0 con 0x7f432c09adb0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43626/0 (socket says 172.21.15.119:43626) 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 -- 172.21.15.119:0/344257682 learned_addr learned my addr 172.21.15.119:0/344257682 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4321400640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c09adb0 0x7f432c13fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f432a800640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1446e0 0x7f432c140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 -- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c09adb0 msgr2=0x7f432c13fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c09adb0 0x7f432c13fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 -- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1446e0 msgr2=0x7f432c140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1446e0 0x7f432c140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 -- 172.21.15.119:0/344257682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c141640 con 0x7f432c072fe0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4329e00640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e960 tx=0x7f431c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c017070 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00ca00 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00cdb0 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c0b0bf0 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.679+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c0729b0 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c067db0 con 0x7f432c072fe0 2024-03-08T21:33:54.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f431c01a070 con 0x7f432c072fe0 2024-03-08T21:33:54.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4322a00640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 0x7f4308069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:54.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f431c085860 con 0x7f432c072fe0 2024-03-08T21:33:54.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4321400640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 0x7f4308069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:54.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.683+0000 7f4321400640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 0x7f4308069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43140b0000 tx=0x7f43140a9000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:54.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.687+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f431c055e80 con 0x7f432c072fe0 2024-03-08T21:33:54.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f432c13c740 con 0x7f432c072fe0 2024-03-08T21:33:54.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4322a00640 1 -- 172.21.15.119:0/344257682 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f431c059f20 con 0x7f432c072fe0 2024-03-08T21:33:54.828 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:54.828 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 msgr2=0x7f4308069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 0x7f4308069b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43140b0000 tx=0x7f43140a9000 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 msgr2=0x7f432c0b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e960 tx=0x7f431c00ee20 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 shutdown_connections 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4308067660 0x7f4308069b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1446e0 0x7f432c140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f432c09adb0 0x7f432c13fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 --2- 172.21.15.119:0/344257682 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c072fe0 0x7f432c0b7540 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 >> 172.21.15.119:0/344257682 conn(0x7f432c06c620 msgr2=0x7f432c06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 shutdown_connections 2024-03-08T21:33:54.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:54.843+0000 7f4331200640 1 -- 172.21.15.119:0/344257682 wait complete. 2024-03-08T21:33:54.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-08T21:33:54.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-08T21:33:54.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-08T21:33:54.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-08T21:33:54.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-08T21:33:54.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-08T21:33:54.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-08T21:33:54.851 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-08T21:33:55.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.099+0000 7fec92800640 1 Processor -- start 2024-03-08T21:33:55.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.099+0000 7fec92800640 1 -- start start 2024-03-08T21:33:55.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.099+0000 7fec92800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec84036540 0x7fec84035560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec92800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840361b0 con 0x7fec840d0e90 2024-03-08T21:33:55.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec92800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec84036980 con 0x7fec84006eb0 2024-03-08T21:33:55.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec92800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec84036e00 con 0x7fec84036540 2024-03-08T21:33:55.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8be00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fec840d0e90 0x7fec840d3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50898/0 (socket says 172.21.15.119:50898) 2024-03-08T21:33:55.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8be00640 1 -- 172.21.15.119:0/2091487711 learned_addr learned my addr 172.21.15.119:0/2091487711 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571442321 0 0) 0x7fec840361b0 con 0x7fec840d0e90 2024-03-08T21:33:55.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8aa00640 1 --2- 172.21.15.119:0/2091487711 >> v2:172.21.15.119:3300/0 conn(0x7fec84036540 0x7fec84035560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7ff4f9800640 1 Processor -- start 2024-03-08T21:33:55.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7ff4f9800640 1 -- start start 2024-03-08T21:33:55.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7f0ab1000640 1 Processor -- start 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec74003530 con 0x7fec840d0e90 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342560596 0 0) 0x7fec84036980 con 0x7fec84006eb0 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec840361b0 con 0x7fec84006eb0 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 878329026 0 0) 0x7fec74003530 con 0x7fec840d0e90 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 >> v2:172.21.15.119:3300/0 conn(0x7fec84036540 msgr2=0x7fec84035560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7f0ab1000640 1 -- start start 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 --2- 172.21.15.119:0/2091487711 >> v2:172.21.15.119:3300/0 conn(0x7fec84036540 0x7fec84035560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 >> v1:172.21.15.160:6789/0 conn(0x7fec84006eb0 legacy=0x7fec84033920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84034e10 con 0x7fec840d0e90 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fec80001680 con 0x7fec840d0e90 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.103+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 >> v1:172.21.15.119:6789/0 conn(0x7fec840d0e90 legacy=0x7fec840d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec74004bb0 0x7fec74004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec740037b0 0x7fec74003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84036e00 con 0x7fec74004170 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400c170 con 0x7fec74004bb0 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400c370 con 0x7fec740037b0 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8b400640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec74004bb0 0x7fec74004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8aa00640 1 --2- 172.21.15.119:0/2091487711 >> v2:172.21.15.119:3300/0 conn(0x7fec84036540 0x7fec84035560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f9800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff4f40b7ef0 0x7ff4f41438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f9800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40b4cc0 con 0x7ff4f4097a80 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f9800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f4142e10 con 0x7ff4f409ad50 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f9800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f4143440 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff4f40b7ef0 0x7ff4f41438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0ab1000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40d4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0ab1000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0aa40d10e0 0x7f0aa40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0ab1000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa4036eb0 con 0x7f0aa40ca430 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0ab1000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa40383c0 con 0x7f0aa40d10e0 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0ab1000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40d4990 con 0x7f0aa4036ad0 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff4f40b7ef0 0x7ff4f41438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35250/0 (socket says 172.21.15.119:35250) 2024-03-08T21:33:55.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 -- 172.21.15.119:0/3011283511 learned_addr learned my addr 172.21.15.119:0/3011283511 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8aa00640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec740037b0 0x7fec74003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 -- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec740037b0 msgr2=0x7fec74003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec740037b0 0x7fec74003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 -- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec74004bb0 msgr2=0x7fec74004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec74004bb0 0x7fec74004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7fec8be00640 1 -- 172.21.15.119:0/2091487711 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74003530 con 0x7fec74004170 2024-03-08T21:33:55.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 -- 172.21.15.119:0/3011283511 >> v1:172.21.15.160:6789/0 conn(0x7ff4f409ad50 legacy=0x7ff4f40b45b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 -- 172.21.15.119:0/3011283511 >> v1:172.21.15.119:6789/0 conn(0x7ff4f4097a80 legacy=0x7ff4f413cde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7ff4f3400640 1 -- 172.21.15.119:0/3011283511 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f414a790 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aaa800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0aa40ca430 0x7f0aa40ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50902/0 (socket says 172.21.15.119:50902) 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aaa800640 1 -- 172.21.15.119:0/3385145634 learned_addr learned my addr 172.21.15.119:0/3385145634 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9400640 1 --2- 172.21.15.119:0/3385145634 >> v2:172.21.15.160:3300/0 conn(0x7f0aa40d10e0 0x7f0aa40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9e00640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa8a00640 1 -- 172.21.15.119:0/3385145634 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648332977 0 0) 0x7f0aa4036eb0 con 0x7f0aa40ca430 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa8a00640 1 -- 172.21.15.119:0/3385145634 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a90003530 con 0x7f0aa40ca430 2024-03-08T21:33:55.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9400640 1 -- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 msgr2=0x7f0aa40d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7ff26ae00640 1 Processor -- start 2024-03-08T21:33:55.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9400640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40d4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9400640 1 -- 172.21.15.119:0/3385145634 >> v1:172.21.15.119:6789/0 conn(0x7f0aa40ca430 legacy=0x7f0aa40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.107+0000 7f0aa9400640 1 -- 172.21.15.119:0/3385145634 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4029be0 con 0x7f0aa40d10e0 2024-03-08T21:33:55.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7f0aa9e00640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:55.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7fec8be00640 1 -- 172.21.15.119:0/2091487711 reap_dead start 2024-03-08T21:33:55.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7fec8be00640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec7400b9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec80004fc0 tx=0x7fec8001f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f3fbca4062cedc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0627f0 con 0x7fec74004170 2024-03-08T21:33:55.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7f0aa9400640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40d10e0 0x7f0aa40d1540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a980097c0 tx=0x7f0a9801c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3ed02f62b3f0b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7ff4f3400640 1 --2- 172.21.15.119:0/3011283511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f40b7ef0 0x7ff4f41438d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009e50 tx=0x7ff4ec01c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d62cd424d991efd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80005ae0 con 0x7fec74004170 2024-03-08T21:33:55.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7ff26ae00640 1 -- start start 2024-03-08T21:33:55.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 0x7ff2640b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 Processor -- start 2024-03-08T21:33:55.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.111+0000 7fec8a000640 1 -- 172.21.15.119:0/2091487711 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80004c10 con 0x7fec74004170 2024-03-08T21:33:55.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff26ae00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 0x7ff26414d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff26ae00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2640b3b20 con 0x7ff26406c620 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff26ae00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26406d0f0 con 0x7ff26406ca80 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff26ae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26413d7f0 con 0x7ff26413d410 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0aa8a00640 1 -- 172.21.15.119:0/3385145634 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980b0070 con 0x7f0aa40d10e0 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 -- start start 2024-03-08T21:33:55.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0aa8a00640 1 -- 172.21.15.119:0/3385145634 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a980ab600 con 0x7f0aa40d10e0 2024-03-08T21:33:55.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0aa8a00640 1 -- 172.21.15.119:0/3385145634 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980ab9d0 con 0x7f0aa40d10e0 2024-03-08T21:33:55.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff4f1600640 1 -- 172.21.15.119:0/3011283511 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0ac020 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff4f1600640 1 -- 172.21.15.119:0/3011283511 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0a64a0 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff4f1600640 1 -- 172.21.15.119:0/3011283511 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0a6870 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 Processor -- start 2024-03-08T21:33:55.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 0x7ff2640b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff26406c620 0x7ff2641465d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50916/0 (socket says 172.21.15.119:50916) 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff268e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 0x7ff26414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff268e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 0x7ff26414d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35264/0 (socket says 172.21.15.119:35264) 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff268e00640 1 -- 172.21.15.119:0/3361918779 learned_addr learned my addr 172.21.15.119:0/3361918779 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7fec92800640 1 -- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 msgr2=0x7fec7400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7fec92800640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec7400b9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec80004fc0 tx=0x7fec8001f9b0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff4f9800640 1 -- 172.21.15.119:0/3011283511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f40b7ef0 msgr2=0x7ff4f41438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff4f9800640 1 --2- 172.21.15.119:0/3011283511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f40b7ef0 0x7ff4f41438d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009e50 tx=0x7ff4ec01c7d0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263e00640 1 -- 172.21.15.119:0/3361918779 >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 msgr2=0x7ff26414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263e00640 1 --2- 172.21.15.119:0/3361918779 >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 0x7ff26414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263e00640 1 -- 172.21.15.119:0/3361918779 >> v1:172.21.15.119:6789/0 conn(0x7ff26406c620 legacy=0x7ff2641465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7ff263e00640 1 -- 172.21.15.119:0/3361918779 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640b4b50 con 0x7ff26413d410 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 0x7f05fc1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc0b3fa0 con 0x7f05fc0b6670 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc146c20 con 0x7f05fc0b4a90 2024-03-08T21:33:55.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0601c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc06dcc0 con 0x7f05fc0b46b0 2024-03-08T21:33:55.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 -- start start 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05fb400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f05fc0b4a90 0x7f05fc13cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:36994/0 (socket says 172.21.15.119:36994) 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05fb400640 1 -- 172.21.15.119:0/108771001 learned_addr learned my addr 172.21.15.119:0/108771001 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919462503 0 0) 0x7f05fc146c20 con 0x7f05fc0b4a90 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e0003530 con 0x7f05fc0b4a90 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3db814c960 0x7f3db814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80b3b20 con 0x7f3db80b2f20 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80b4b50 con 0x7f3db813d410 2024-03-08T21:33:55.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbec00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db806d0f0 con 0x7f3db814c960 2024-03-08T21:33:55.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555840646 0 0) 0x7f05fc0b3fa0 con 0x7f05fc0b6670 2024-03-08T21:33:55.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05fc146c20 con 0x7f05fc0b6670 2024-03-08T21:33:55.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3db7e00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3db813d410 0x7f3db806c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37000/0 (socket says 172.21.15.119:37000) 2024-03-08T21:33:55.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3db7e00640 1 -- 172.21.15.119:0/4066878484 learned_addr learned my addr 172.21.15.119:0/4066878484 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f3dbcc00640 1 --2- 172.21.15.119:0/4066878484 >> v2:172.21.15.119:3300/0 conn(0x7f3db814c960 0x7f3db814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f05fbe00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 0x7f05fc1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 -- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40d10e0 msgr2=0x7f0aa40d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40d10e0 0x7f0aa40d1540 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a980097c0 tx=0x7f0a9801c4e0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 -- 172.21.15.119:0/3385145634 shutdown_connections 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40d10e0 0x7f0aa40d1540 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a980097c0 tx=0x7f0a9801c4e0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 --2- 172.21.15.119:0/3385145634 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 -- 172.21.15.119:0/3385145634 >> 172.21.15.119:0/3385145634 conn(0x7f0aa403ac00 msgr2=0x7f0aa4005ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 -- 172.21.15.119:0/3385145634 shutdown_connections 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.115+0000 7f0ab1000640 1 -- 172.21.15.119:0/3385145634 wait complete. 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866742880 0 0) 0x7f05e0003530 con 0x7f05fc0b4a90 2024-03-08T21:33:55.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 msgr2=0x7f05fc1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 -- 172.21.15.119:0/2091487711 shutdown_connections 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 --2- 172.21.15.119:0/2091487711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec7400b9d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 -- 172.21.15.119:0/2091487711 >> 172.21.15.119:0/2091487711 conn(0x7fec8403a860 msgr2=0x7fec8403ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff4f9800640 1 -- 172.21.15.119:0/3011283511 shutdown_connections 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff4f9800640 1 --2- 172.21.15.119:0/3011283511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f40b7ef0 0x7ff4f41438d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff4f9800640 1 -- 172.21.15.119:0/3011283511 >> 172.21.15.119:0/3011283511 conn(0x7ff4f409a230 msgr2=0x7ff4f409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff4f9800640 1 -- 172.21.15.119:0/3011283511 shutdown_connections 2024-03-08T21:33:55.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff4f9800640 1 -- 172.21.15.119:0/3011283511 wait complete. 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 Processor -- start 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 -- start start 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40ca430 0x7f0aa40c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0aa40c3ae0 0x7f0aa40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff263e00640 1 --2- 172.21.15.119:0/3361918779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 0x7ff2640b2f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2540097c0 tx=0x7ff25401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec688fe1d815a7b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 0x7f05fc1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 >> v1:172.21.15.119:6789/0 conn(0x7f05fc0b6670 legacy=0x7f05fc0b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc146f00 con 0x7f05fc0b4a90 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f05ec001680 con 0x7f05fc0b4a90 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 >> v1:172.21.15.160:6789/0 conn(0x7f05fc0b4a90 legacy=0x7f05fc13cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e0003b80 0x7f05e0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0004810 0x7f05e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 0x7f05e0005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc06dcc0 con 0x7f05e0003b80 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0005b80 con 0x7f05e0004810 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0005d80 con 0x7f05fc0b46b0 2024-03-08T21:33:55.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265708328 0 0) 0x7f3db80b3b20 con 0x7f3db80b2f20 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d9c003530 con 0x7f3db80b2f20 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51739058 0 0) 0x7f3db80b4b50 con 0x7f3db813d410 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3db80b3b20 con 0x7f3db813d410 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3dbcc00640 1 -- 172.21.15.119:0/4066878484 >> v1:172.21.15.160:6789/0 conn(0x7f3db813d410 legacy=0x7f3db806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3dbcc00640 1 -- 172.21.15.119:0/4066878484 >> v1:172.21.15.119:6789/0 conn(0x7f3db80b2f20 legacy=0x7f3db81465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f3dbcc00640 1 -- 172.21.15.119:0/4066878484 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db806cd30 con 0x7f3db814c960 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0aa40c3ae0 0x7f0aa40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aaa800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0aa40c3ae0 0x7f0aa40c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43674/0 (socket says 172.21.15.119:43674) 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37532/0 (socket says 172.21.15.119:37532) 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aaa800640 1 -- 172.21.15.119:0/2504916784 learned_addr learned my addr 172.21.15.119:0/2504916784 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40ddcd0 con 0x7f0aa40c3ae0 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40ddb50 con 0x7f0aa40ca430 2024-03-08T21:33:55.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40dde50 con 0x7f0aa4036ad0 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e0003b80 0x7f05e0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 -- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 msgr2=0x7f05e0005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc0b46b0 0x7f05e0005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 -- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0004810 msgr2=0x7f05e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fb400640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0004810 0x7f05e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0004810 0x7f05e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fbe00640 1 -- 172.21.15.119:0/108771001 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0003530 con 0x7f05e0003b80 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 -- 172.21.15.119:0/2091487711 shutdown_connections 2024-03-08T21:33:55.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 -- 172.21.15.119:0/2091487711 wait complete. 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 Processor -- start 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7fec92800640 1 -- start start 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 -- 172.21.15.119:0/2504916784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40ca430 msgr2=0x7f0aa40c35a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0aa40ca430 0x7f0aa40c35a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff262a00640 1 -- 172.21.15.119:0/3361918779 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540b0070 con 0x7ff26413d410 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff262a00640 1 -- 172.21.15.119:0/3361918779 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2540ab600 con 0x7ff26413d410 2024-03-08T21:33:55.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7ff262a00640 1 -- 172.21.15.119:0/3361918779 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2540ab9d0 con 0x7ff26413d410 2024-03-08T21:33:55.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f05fb400640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0004810 0x7f05e0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:55.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 -- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0aa40c3ae0 msgr2=0x7f0aa40c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0aa40c3ae0 0x7f0aa40c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.119+0000 7f0aa9e00640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4169390 con 0x7f0aa4036ad0 2024-03-08T21:33:55.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0aa9e00640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40c4c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e810 tx=0x7f0a9c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 -- 172.21.15.119:0/3361918779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 msgr2=0x7ff2640b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 --2- 172.21.15.119:0/3361918779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 0x7ff2640b2f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2540097c0 tx=0x7ff25401c3d0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec8416b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c017070 con 0x7f0aa4036ad0 2024-03-08T21:33:55.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa40c61c0 con 0x7f0aa4036ad0 2024-03-08T21:33:55.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 Processor -- start 2024-03-08T21:33:55.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00c6d0 con 0x7f0aa4036ad0 2024-03-08T21:33:55.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00f040 con 0x7f0aa4036ad0 2024-03-08T21:33:55.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa40c51a0 con 0x7f0aa4036ad0 2024-03-08T21:33:55.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec8416b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec8416b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43682/0 (socket says 172.21.15.119:43682) 2024-03-08T21:33:55.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 -- start start 2024-03-08T21:33:55.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff4f9800640 1 Processor -- start 2024-03-08T21:33:55.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec8415a540 0x7fec8416be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec84172190 0x7fec84172620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8b400640 1 -- 172.21.15.119:0/436960548 learned_addr learned my addr 172.21.15.119:0/436960548 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84029e60 con 0x7fec74004170 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840c2be0 con 0x7fec8415a540 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec92800640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8415b180 con 0x7fec84172190 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec8415a540 0x7fec8416be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff4f9800640 1 -- start start 2024-03-08T21:33:55.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8be00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec84172190 0x7fec84172620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0aa40053d0 con 0x7f0aa4036ad0 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 -- 172.21.15.119:0/3361918779 shutdown_connections 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 --2- 172.21.15.119:0/3361918779 >> v2:172.21.15.160:3300/0 conn(0x7ff26406ca80 0x7ff26414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 --2- 172.21.15.119:0/3361918779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26413d410 0x7ff2640b2f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 -- 172.21.15.119:0/3361918779 >> 172.21.15.119:0/3361918779 conn(0x7ff2640b8520 msgr2=0x7ff2640b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 -- 172.21.15.119:0/3361918779 shutdown_connections 2024-03-08T21:33:55.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 -- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec84172190 msgr2=0x7fec84172620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec84172190 0x7fec84172620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 -- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 msgr2=0x7fec8416b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fd961600640 1 Processor -- start 2024-03-08T21:33:55.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec8416b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec841597f0 con 0x7fec8415a540 2024-03-08T21:33:55.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8b400640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec74004170 0x7fec8416b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f05fbe00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e0003b80 0x7f05e0003f60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05f4004b30 tx=0x7f05f4025450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05146092e59360 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fec8aa00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec8415a540 0x7fec8416be20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec8c069ba0 tx=0x7fec8c068890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7ff26ae00640 1 -- 172.21.15.119:0/3361918779 wait complete. 2024-03-08T21:33:55.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7fd961600640 1 -- start start 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5e480c9400 0x7f5e480c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4800c740 con 0x7f5e4800c360 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4801dac0 con 0x7f5e480c9400 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f5e4fe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480cc9e0 con 0x7f5e480cce70 2024-03-08T21:33:55.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4009c10 con 0x7f05e0003b80 2024-03-08T21:33:55.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c09a070 con 0x7fec8415a540 2024-03-08T21:33:55.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f05faa00640 1 -- 172.21.15.119:0/108771001 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f40b9070 con 0x7f05e0003b80 2024-03-08T21:33:55.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c062240 con 0x7fec8415a540 2024-03-08T21:33:55.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c062610 con 0x7fec8415a540 2024-03-08T21:33:55.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec92800640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec84159a90 con 0x7fec8415a540 2024-03-08T21:33:55.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 Processor -- start 2024-03-08T21:33:55.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec92800640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec84156fd0 con 0x7fec8415a540 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f4097a80 0x7ff4f413ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 0x7ff4f413bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f40b7ef0 0x7ff4f41dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41555d0 con 0x7ff4f409ad50 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40b76d0 con 0x7ff4f4097a80 2024-03-08T21:33:55.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f9800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4155750 con 0x7ff4f40b7ef0 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.123+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0a9c01a070 con 0x7f0aa4036ad0 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa2000640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0a8c0676e0 0x7f0a8c069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a9c084ef0 con 0x7f0aa4036ad0 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 -- 172.21.15.119:0/108771001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e0003b80 msgr2=0x7f05e0003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 --2- 172.21.15.119:0/108771001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e0003b80 0x7f05e0003f60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05f4004b30 tx=0x7f05f4025450 comp rx=0 tx=0).stop 2024-03-08T21:33:55.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601200640 1 -- 172.21.15.119:0/108771001 reap_dead start 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec840053a0 con 0x7fec8415a540 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa2000640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f0a8c06f960 0x7f0a8c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a8c072430 con 0x7f0a8c06f960 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9c087510 con 0x7f0aa4036ad0 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aa9400640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0a8c0676e0 0x7f0a8c069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37540/0 (socket says 172.21.15.119:37540) 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 -- 172.21.15.119:0/303468498 learned_addr learned my addr 172.21.15.119:0/303468498 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd961600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd954006eb0 0x7fd954036540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd961600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd9540d0e90 0x7fd9540d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd961600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540361b0 con 0x7fd954033920 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd961600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd954036e00 con 0x7fd9540d0e90 2024-03-08T21:33:55.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd961600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd954029fb0 con 0x7fd954006eb0 2024-03-08T21:33:55.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 -- 172.21.15.119:0/108771001 shutdown_connections 2024-03-08T21:33:55.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 -- 172.21.15.119:0/108771001 >> 172.21.15.119:0/108771001 conn(0x7f05fc09a230 msgr2=0x7f05fc09a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 -- 172.21.15.119:0/108771001 shutdown_connections 2024-03-08T21:33:55.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0601c00640 1 -- 172.21.15.119:0/108771001 wait complete. 2024-03-08T21:33:55.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aaa800640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f0a8c06f960 0x7f0a8c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 -- start start 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 0x7ff4f413bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 0x7ff4f413bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43690/0 (socket says 172.21.15.119:43690) 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f2000640 1 -- 172.21.15.119:0/2085789395 learned_addr learned my addr 172.21.15.119:0/2085789395 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f2a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f4097a80 0x7ff4f413ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff4f3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f40b7ef0 0x7ff4f41dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f0aaa800640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f0a8c06f960 0x7f0a8c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 0x7ff2640b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff26406ca80 0x7ff2641e7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff26413d410 0x7ff26413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff263e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 0x7ff2640b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff263e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 0x7ff2640b75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37574/0 (socket says 172.21.15.119:37574) 2024-03-08T21:33:55.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff263e00640 1 -- 172.21.15.119:0/2792618894 learned_addr learned my addr 172.21.15.119:0/2792618894 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264150a50 con 0x7ff26413d410 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2641508d0 con 0x7ff26406ca80 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff264150bd0 con 0x7ff26406c620 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff263400640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff26406ca80 0x7ff2641e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff26413d410 0x7ff26413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 -- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 msgr2=0x7ff2640b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 0x7ff2640b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 -- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff26406ca80 msgr2=0x7ff2641e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff26406ca80 0x7ff2641e7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff268e00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff264143c20 con 0x7ff26413d410 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7ff263e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff26406c620 0x7ff2640b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff268e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff26413d410 0x7ff26413fc00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff25c004380 tx=0x7ff25c004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 -- 172.21.15.119:0/303468498 >> v2:172.21.15.160:3300/0 conn(0x7f5e480c9400 msgr2=0x7f5e480c9870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 --2- 172.21.15.119:0/303468498 >> v2:172.21.15.160:3300/0 conn(0x7f5e480c9400 0x7f5e480c9870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 -- 172.21.15.119:0/303468498 >> v1:172.21.15.119:6789/0 conn(0x7f5e4800c360 legacy=0x7f5e4801dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7f5e4e000640 1 -- 172.21.15.119:0/303468498 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4801e720 con 0x7f5e480cce70 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd95b400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd954033920 0x7fd954035560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37002/0 (socket says 172.21.15.119:37002) 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd95b400640 1 -- 172.21.15.119:0/1303278951 learned_addr learned my addr 172.21.15.119:0/1303278951 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166641269 0 0) 0x7fd9540361b0 con 0x7fd954033920 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00aac0 con 0x7ff26413d410 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd944003510 con 0x7fd954033920 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.127+0000 7fd960c00640 1 --2- 172.21.15.119:0/1303278951 >> v2:172.21.15.160:3300/0 conn(0x7fd9540d0e90 0x7fd9540d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462906554 0 0) 0x7fd944003510 con 0x7fd954033920 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd954006eb0 msgr2=0x7fd954036540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-08T21:33:55.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd954006eb0 0x7fd954036540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 >> v2:172.21.15.160:3300/0 conn(0x7fd9540d0e90 msgr2=0x7fd9540d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 --2- 172.21.15.119:0/1303278951 >> v2:172.21.15.160:3300/0 conn(0x7fd9540d0e90 0x7fd9540d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954034e10 con 0x7fd954033920 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fd948001680 con 0x7fd954033920 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 >> v1:172.21.15.160:6789/0 conn(0x7fd954033920 legacy=0x7fd954035560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd944003b70 0x7fd944003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd944006770 0x7fd944008c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd944009400 0x7fd94400b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954036e00 con 0x7fd944009400 2024-03-08T21:33:55.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954029fb0 con 0x7fd944006770 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c00ac80 con 0x7ff26413d410 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c016430 con 0x7ff26413d410 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94400c1f0 con 0x7fd944003b70 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 -- 172.21.15.119:0/2085789395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f40b7ef0 msgr2=0x7ff4f41dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f40b7ef0 0x7ff4f41dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 -- 172.21.15.119:0/2085789395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f4097a80 msgr2=0x7ff4f413ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f4097a80 0x7ff4f413ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4099100 con 0x7ff4f409ad50 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff264143140 con 0x7ff26413d410 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26413e6d0 con 0x7ff26413d410 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 Processor -- start 2024-03-08T21:33:55.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 -- start start 2024-03-08T21:33:55.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd944003b70 0x7fd944003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff264067db0 con 0x7ff26413d410 2024-03-08T21:33:55.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f2000640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 0x7ff4f413bfc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b3e0 tx=0x7ff4e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0015020 con 0x7ff4f409ad50 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 -- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd944006770 msgr2=0x7fd944008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd944006770 0x7fd944008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 -- 172.21.15.119:0/1303278951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd944009400 msgr2=0x7fd94400b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd944009400 0x7fd94400b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fd95be00640 1 -- 172.21.15.119:0/1303278951 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944003510 con 0x7fd944003b70 2024-03-08T21:33:55.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0011850 con 0x7ff4f409ad50 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011c40 con 0x7ff4f409ad50 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0003b80 0x7f05fc13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 0x7f05fc09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc09d160 0x7f05fc093d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14ef70 con 0x7f05fc09df80 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1469e0 con 0x7f05e0003b80 2024-03-08T21:33:55.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f0601c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14f0f0 con 0x7f05fc09d160 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 0x7f05fc09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 0x7f05fc09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43728/0 (socket says 172.21.15.119:43728) 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 -- 172.21.15.119:0/3747081171 learned_addr learned my addr 172.21.15.119:0/3747081171 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fbe00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0003b80 0x7f05fc13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 -- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc09d160 msgr2=0x7f05fc093d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05fc09d160 0x7f05fc093d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 -- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0003b80 msgr2=0x7f05fc13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0003b80 0x7f05fc13d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc13eef0 con 0x7f05fc09df80 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fbe00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05e0003b80 0x7f05fc13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:55.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f40993e0 con 0x7ff4f409ad50 2024-03-08T21:33:55.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f5e4e000640 1 --2- 172.21.15.119:0/303468498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009870 tx=0x7f5e3c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f1a26dbdfb0c36 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f5e4d600640 1 -- 172.21.15.119:0/303468498 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0b0070 con 0x7f5e480cce70 2024-03-08T21:33:55.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f5e4d600640 1 -- 172.21.15.119:0/303468498 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0ab600 con 0x7f5e480cce70 2024-03-08T21:33:55.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f5e4d600640 1 -- 172.21.15.119:0/303468498 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0ab9d0 con 0x7f5e480cce70 2024-03-08T21:33:55.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff25c0153d0 con 0x7ff26413d410 2024-03-08T21:33:55.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbcc00640 1 --2- 172.21.15.119:0/4066878484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db814c960 0x7f3db814ed50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009d90 tx=0x7f3db001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aae3474db357307 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff244067760 0x7ff244069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff25c0864b0 con 0x7ff26413d410 2024-03-08T21:33:55.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7ff24406f9e0 0x7ff244071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00b2070 con 0x7f3db814c960 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00a5760 con 0x7f3db814c960 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7f05fb400640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 0x7f05fc09cc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05ec007fd0 tx=0x7f05ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec019070 con 0x7f05fc09df80 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc090e00 con 0x7f05fc09df80 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc13ec10 con 0x7f05fc09df80 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00de50 con 0x7f05fc09df80 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec023060 con 0x7f05fc09df80 2024-03-08T21:33:55.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05fc09c950 con 0x7f05fc09df80 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.131+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fec8c09d070 con 0x7fec8415a540 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fec7f400640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fec6c067760 0x7fec6c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec8c0ffcc0 con 0x7fec8415a540 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fec7f400640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7fec6c06f960 0x7fec6c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2440724b0 con 0x7ff24406f9e0 2024-03-08T21:33:55.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff25c0868a0 con 0x7ff26413d410 2024-03-08T21:33:55.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f40996c0 con 0x7ff4f409ad50 2024-03-08T21:33:55.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff263400640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7ff24406f9e0 0x7ff244071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3db6a00640 1 -- 172.21.15.119:0/4066878484 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db00a5b10 con 0x7f3db814c960 2024-03-08T21:33:55.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 -- 172.21.15.119:0/4066878484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db814c960 msgr2=0x7f3db814ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 --2- 172.21.15.119:0/4066878484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db814c960 0x7f3db814ed50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009d90 tx=0x7f3db001c8a0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fec8b400640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fec6c067760 0x7fec6c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff263400640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7ff24406f9e0 0x7ff244071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 -- 172.21.15.119:0/4066878484 shutdown_connections 2024-03-08T21:33:55.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 --2- 172.21.15.119:0/4066878484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db814c960 0x7f3db814ed50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 -- 172.21.15.119:0/4066878484 >> 172.21.15.119:0/4066878484 conn(0x7f3db80b8520 msgr2=0x7f3db80b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== osd.2 v2:172.21.15.119:6824/2768009528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0a8c072430 con 0x7f0a8c06f960 2024-03-08T21:33:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f0aa9400640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0a8c0676e0 0x7f0a8c069ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ad000 tx=0x7f0a980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fd95be00640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd944003b70 0x7fd944003f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9540076f0 tx=0x7fd95001c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838038f0a037e6b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7ff263e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff244067760 0x7ff244069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 -- 172.21.15.119:0/4066878484 shutdown_connections 2024-03-08T21:33:55.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500b0070 con 0x7fd944003b70 2024-03-08T21:33:55.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500ab600 con 0x7fd944003b70 2024-03-08T21:33:55.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.135+0000 7f3dbec00640 1 -- 172.21.15.119:0/4066878484 wait complete. 2024-03-08T21:33:55.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f05ec01c070 con 0x7f05fc09df80 2024-03-08T21:33:55.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 Processor -- start 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd95aa00640 1 -- 172.21.15.119:0/1303278951 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500093b0 con 0x7fd944003b70 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd944003b70 msgr2=0x7fd944003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 --2- 172.21.15.119:0/1303278951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd944003b70 0x7fd944003f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9540076f0 tx=0x7fd95001c280 comp rx=0 tx=0).stop 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd960c00640 1 -- 172.21.15.119:0/1303278951 reap_dead start 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- 172.21.15.119:0/1303278951 shutdown_connections 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- 172.21.15.119:0/1303278951 >> 172.21.15.119:0/1303278951 conn(0x7fd95403a860 msgr2=0x7fd95403ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- 172.21.15.119:0/1303278951 shutdown_connections 2024-03-08T21:33:55.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- 172.21.15.119:0/1303278951 wait complete. 2024-03-08T21:33:55.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fec8b400640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fec6c067760 0x7fec6c069c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec78001c20 tx=0x7fec78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4f40750f0 con 0x7ff4f409ad50 2024-03-08T21:33:55.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- start start 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db80b2f20 0x7f3db8140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 0x7f3db81e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db814c960 0x7f3db81e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8151cc0 con 0x7f3db80b2f20 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db813d7f0 con 0x7f3db814c960 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8151e40 con 0x7f3db813d410 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 -- 172.21.15.119:0/303468498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 msgr2=0x7f5e480cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/303468498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009870 tx=0x7f5e3c01c4b0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05dc067660 0x7f05dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 -- 172.21.15.119:0/303468498 shutdown_connections 2024-03-08T21:33:55.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05ec085af0 con 0x7f05fc09df80 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 0x7f3db81e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbcc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db814c960 0x7f3db81e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 0x7f3db81e42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37588/0 (socket says 172.21.15.119:37588) 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 -- 172.21.15.119:0/4169620889 learned_addr learned my addr 172.21.15.119:0/4169620889 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f05dc06f800 0x7f05dc071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ec00af20 con 0x7f05dc06f800 2024-03-08T21:33:55.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05ec085ee0 con 0x7f05fc09df80 2024-03-08T21:33:55.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/303468498 >> v2:172.21.15.160:3300/0 conn(0x7f5e480c9400 0x7f5e480c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/303468498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e480cce70 0x7f5e480cd2d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 -- 172.21.15.119:0/303468498 >> 172.21.15.119:0/303468498 conn(0x7f5e4800b5e0 msgr2=0x7f5e4800b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fec8be00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7fec6c06f960 0x7fec6c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff4e0018020 con 0x7ff4f409ad50 2024-03-08T21:33:55.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f0601200640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f05dc06f800 0x7f05dc071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 -- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db814c960 msgr2=0x7f3db81e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db814c960 0x7f3db81e4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 -- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db80b2f20 msgr2=0x7f3db8140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db80b2f20 0x7f3db8140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db81e7e00 con 0x7f3db813d410 2024-03-08T21:33:55.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 -- 172.21.15.119:0/303468498 shutdown_connections 2024-03-08T21:33:55.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec8c06cd30 con 0x7fec6c06f960 2024-03-08T21:33:55.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3db7400640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 0x7f3db81e42d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c490 tx=0x7f3da400c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 Processor -- start 2024-03-08T21:33:55.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec8c0cc600 con 0x7fec8415a540 2024-03-08T21:33:55.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40052d0 con 0x7f3db813d410 2024-03-08T21:33:55.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da4005470 con 0x7f3db813d410 2024-03-08T21:33:55.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4012910 con 0x7f3db813d410 2024-03-08T21:33:55.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f0601200640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f05dc06f800 0x7f05dc071c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== osd.3 v2:172.21.15.119:6816/937098264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff2440724b0 con 0x7ff24406f9e0 2024-03-08T21:33:55.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f5e4fe00640 1 -- 172.21.15.119:0/303468498 wait complete. 2024-03-08T21:33:55.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4eaa00640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff4d40676b0 0x7ff4d4069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db81e80e0 con 0x7f3db813d410 2024-03-08T21:33:55.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db8140560 con 0x7f3db813d410 2024-03-08T21:33:55.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff263e00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff244067760 0x7ff244069c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2540097c0 tx=0x7ff254008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== osd.4 v2:172.21.15.160:6800/1676941405 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f05ec00af20 con 0x7f05dc06f800 2024-03-08T21:33:55.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4e0086020 con 0x7ff4f409ad50 2024-03-08T21:33:55.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7fec8be00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7fec6c06f960 0x7fec6c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d90001040 con 0x7f3db813d410 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4eaa00640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7ff4d406f930 0x7ff4d4071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4d4072400 con 0x7ff4d406f930 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e008f050 con 0x7ff4f409ad50 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4f2a00640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff4d40676b0 0x7ff4d4069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4f3400640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7ff4d406f930 0x7ff4d4071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== osd.0 v2:172.21.15.119:6800/457875351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fec8c06cd30 con 0x7fec6c06f960 2024-03-08T21:33:55.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7ff4f3400640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7ff4d406f930 0x7ff4d4071d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7f5e4fe00640 1 Processor -- start 2024-03-08T21:33:55.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7f05fbe00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05dc067660 0x7f05dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3da4012ab0 con 0x7f3db813d410 2024-03-08T21:33:55.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dafe00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d98067760 0x7f3d98069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3da4085ee0 con 0x7f3db813d410 2024-03-08T21:33:55.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dafe00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f3d9806f9e0 0x7f3d98071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 -- start start 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.139+0000 7fd961600640 1 -- start start 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.143+0000 7fd961600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd954160f70 0x7fd9540bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd961600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9540bd3e0 0x7fd954161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd961600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 0x7fd9540bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd961600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540c2be0 con 0x7fd954160f70 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd961600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954035c70 con 0x7fd954161890 2024-03-08T21:33:55.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd961600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540c2d60 con 0x7fd9540bd3e0 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d980724b0 con 0x7f3d9806f9e0 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3da40862d0 con 0x7f3db813d410 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3db7e00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d98067760 0x7f3d98069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dbcc00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f3d9806f9e0 0x7f3d98071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 0x7fd9540bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 0x7fd9540bb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35404/0 (socket says 172.21.15.119:35404) 2024-03-08T21:33:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 -- 172.21.15.119:0/839929533 learned_addr learned my addr 172.21.15.119:0/839929533 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7ff4f2a00640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff4d40676b0 0x7ff4d4069b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009980 tx=0x7ff4e40090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== osd.1 v2:172.21.15.119:6808/585002504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff4d4072400 con 0x7ff4d406f930 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 0x7f5e480221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e480c9400 0x7f5e48037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e480cce70 0x7f5e48168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480d9c90 con 0x7f5e480c9400 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4803c440 con 0x7f5e480cce70 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4fe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480d9e10 con 0x7f5e4800c360 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd95b400640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9540bd3e0 0x7fd954161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 -- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9540bd3e0 msgr2=0x7fd954161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9540bd3e0 0x7fd954161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 -- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd954160f70 msgr2=0x7fd9540bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd954160f70 0x7fd9540bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954161d20 con 0x7fd954161890 2024-03-08T21:33:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3dbcc00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f3d9806f9e0 0x7f3d98071e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 0x7f5e480221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 0x7f5e480221f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37610/0 (socket says 172.21.15.119:37610) 2024-03-08T21:33:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 -- 172.21.15.119:0/4070929464 learned_addr learned my addr 172.21.15.119:0/4070929464 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4f400640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e480cce70 0x7f5e48168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f05fbe00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05dc067660 0x7f05dc069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05f40b8000 tx=0x7f05f4004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f3db7e00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d98067760 0x7f3d98069c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3da8000c10 tx=0x7f3da8007950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd960c00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 0x7fd9540bb7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd95c073bf0 tx=0x7fd95c04f5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 -- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e480cce70 msgr2=0x7f5e48168bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e480cce70 0x7f5e48168bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 -- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e480c9400 msgr2=0x7f5e48037cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e480c9400 0x7f5e48037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48039f90 con 0x7f5e4800c360 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4f400640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e480cce70 0x7f5e48168bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c072bc0 con 0x7fd954161890 2024-03-08T21:33:55.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c091030 con 0x7fd954161890 2024-03-08T21:33:55.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c096420 con 0x7fd954161890 2024-03-08T21:33:55.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.147+0000 7f5e4ea00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 0x7f5e480221f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c490 tx=0x7f5e40001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.151+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== osd.5 v2:172.21.15.160:6816/3177605674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3d980724b0 con 0x7f3d9806f9e0 2024-03-08T21:33:55.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.151+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9540c3670 con 0x7fd954161890 2024-03-08T21:33:55.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.151+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9540bc9a0 con 0x7fd954161890 2024-03-08T21:33:55.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.151+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9540053a0 con 0x7fd954161890 2024-03-08T21:33:55.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40017070 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40003600 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40003a30 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e48039540 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e48039260 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e28001040 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.155+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5e40003bd0 con 0x7f5e4800c360 2024-03-08T21:33:55.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd95c0b5870 con 0x7fd954161890 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e46a00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5e30067660 0x7f5e30069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e40084b70 con 0x7f5e4800c360 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e46a00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5e3006f860 0x7f5e30071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e40035ea0 con 0x7f5e3006f860 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e40085000 con 0x7f5e4800c360 2024-03-08T21:33:55.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e4f400640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5e3006f860 0x7f5e30071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd93c067730 0x7fd93c069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd95c100190 con 0x7fd954161890 2024-03-08T21:33:55.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7fd93c06f9b0 0x7fd93c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd95be00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd93c067730 0x7fd93c069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e4e000640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5e30067660 0x7f5e30069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7f5e4f400640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5e3006f860 0x7f5e30071c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd95c08de50 con 0x7fd93c06f9b0 2024-03-08T21:33:55.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.159+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95c100580 con 0x7fd954161890 2024-03-08T21:33:55.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.163+0000 7f5e4e000640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5e30067660 0x7f5e30069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0ad000 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.163+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== osd.6 v2:172.21.15.160:6824/2462175977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5e40035ea0 con 0x7f5e3006f860 2024-03-08T21:33:55.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.163+0000 7fd95b400640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7fd93c06f9b0 0x7fd93c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.163+0000 7fd95be00640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd93c067730 0x7fd93c069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ad000 tx=0x7fd950004710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.167+0000 7fd95b400640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7fd93c06f9b0 0x7fd93c071dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.167+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== osd.7 v2:172.21.15.160:6808/1919516380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd95c08de50 con 0x7fd93c06f9b0 2024-03-08T21:33:55.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.167+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 --> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0aa40db110 con 0x7f0a8c06f960 2024-03-08T21:33:55.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.171+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 --> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff26409d3a0 con 0x7ff24406f9e0 2024-03-08T21:33:55.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.171+0000 7f0aa2000640 1 -- 172.21.15.119:0/2504916784 <== osd.2 v2:172.21.15.119:6824/2768009528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0aa40db110 con 0x7f0a8c06f960 2024-03-08T21:33:55.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.171+0000 7ff25be00640 1 -- 172.21.15.119:0/2792618894 <== osd.3 v2:172.21.15.119:6816/937098264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff26409d3a0 con 0x7ff24406f9e0 2024-03-08T21:33:55.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7ff24406f9e0 msgr2=0x7ff244071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7ff24406f9e0 0x7ff244071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f0a8c06f960 msgr2=0x7f0a8c071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f0a8c06f960 0x7f0a8c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff244067760 msgr2=0x7ff244069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff244067760 0x7ff244069c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2540097c0 tx=0x7ff254008040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff26413d410 msgr2=0x7ff26413fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 --2- 172.21.15.119:0/2792618894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff26413d410 0x7ff26413fc00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff25c004380 tx=0x7ff25c004840 comp rx=0 tx=0).stop 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff268e00640 1 -- 172.21.15.119:0/2792618894 reap_dead start 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 shutdown_connections 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 >> 172.21.15.119:0/2792618894 conn(0x7ff2640b8520 msgr2=0x7ff2640b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0a8c0676e0 msgr2=0x7f0a8c069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0a8c0676e0 0x7f0a8c069ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ad000 tx=0x7f0a980a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 msgr2=0x7f0aa40c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 --2- 172.21.15.119:0/2504916784 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0aa4036ad0 0x7f0aa40c4c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e810 tx=0x7f0a9c00ec10 comp rx=0 tx=0).stop 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0aaa800640 1 -- 172.21.15.119:0/2504916784 reap_dead start 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 shutdown_connections 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 shutdown_connections 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 >> 172.21.15.119:0/2504916784 conn(0x7f0aa403ac00 msgr2=0x7f0aa40cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 shutdown_connections 2024-03-08T21:33:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0ab1000640 1 -- 172.21.15.119:0/2504916784 wait complete. 2024-03-08T21:33:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff26ae00640 1 -- 172.21.15.119:0/2792618894 wait complete. 2024-03-08T21:33:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 --> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d90002de0 con 0x7f3d9806f9e0 2024-03-08T21:33:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 --> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec8403bb60 con 0x7fec6c06f960 2024-03-08T21:33:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 --> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05fc09d610 con 0x7f05dc06f800 2024-03-08T21:33:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f3dafe00640 1 -- 172.21.15.119:0/4169620889 <== osd.5 v2:172.21.15.160:6816/3177605674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d90002de0 con 0x7f3d9806f9e0 2024-03-08T21:33:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 --> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4f41df770 con 0x7ff4d406f930 2024-03-08T21:33:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.175+0000 7f05f3e00640 1 -- 172.21.15.119:0/3747081171 <== osd.4 v2:172.21.15.160:6800/1676941405 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05fc09d610 con 0x7f05dc06f800 2024-03-08T21:33:55.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7f400640 1 -- 172.21.15.119:0/436960548 <== osd.0 v2:172.21.15.119:6800/457875351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec8403bb60 con 0x7fec6c06f960 2024-03-08T21:33:55.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f05dc06f800 msgr2=0x7f05dc071c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f05dc06f800 0x7f05dc071c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7fec6c06f960 msgr2=0x7fec6c071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7fec6c06f960 0x7fec6c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4eaa00640 1 -- 172.21.15.119:0/2085789395 <== osd.1 v2:172.21.15.119:6808/585002504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4f41df770 con 0x7ff4d406f930 2024-03-08T21:33:55.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05dc067660 msgr2=0x7f05dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05dc067660 0x7f05dc069b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05f40b8000 tx=0x7f05f4004ac0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 msgr2=0x7f05fc09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 --2- 172.21.15.119:0/3747081171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05fc09df80 0x7f05fc09cc20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f05ec007fd0 tx=0x7f05ec00dc00 comp rx=0 tx=0).stop 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fec6c067760 msgr2=0x7fec6c069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fec6c067760 0x7fec6c069c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec78001c20 tx=0x7fec78009040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec8415a540 msgr2=0x7fec8416be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 --2- 172.21.15.119:0/436960548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec8415a540 0x7fec8416be20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec8c069ba0 tx=0x7fec8c068890 comp rx=0 tx=0).stop 2024-03-08T21:33:55.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601200640 1 -- 172.21.15.119:0/3747081171 reap_dead start 2024-03-08T21:33:55.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec8be00640 1 -- 172.21.15.119:0/436960548 reap_dead start 2024-03-08T21:33:55.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 shutdown_connections 2024-03-08T21:33:55.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 >> 172.21.15.119:0/436960548 conn(0x7fec8403a860 msgr2=0x7fec84006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7ff4d406f930 msgr2=0x7ff4d4071d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7ff4d406f930 0x7ff4d4071d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f3d9806f9e0 msgr2=0x7f3d98071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f3d9806f9e0 0x7f3d98071e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 shutdown_connections 2024-03-08T21:33:55.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 >> 172.21.15.119:0/3747081171 conn(0x7f05fc09a230 msgr2=0x7f05fc1459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 shutdown_connections 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d98067760 msgr2=0x7f3d98069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d98067760 0x7f3d98069c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3da8000c10 tx=0x7f3da8007950 comp rx=0 tx=0).stop 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 msgr2=0x7f3db81e42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbec00640 1 --2- 172.21.15.119:0/4169620889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3db813d410 0x7f3db81e42d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c490 tx=0x7f3da400c950 comp rx=0 tx=0).stop 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 shutdown_connections 2024-03-08T21:33:55.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7fec7cc00640 1 -- 172.21.15.119:0/436960548 wait complete. 2024-03-08T21:33:55.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f0601c00640 1 -- 172.21.15.119:0/3747081171 wait complete. 2024-03-08T21:33:55.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7f3dbcc00640 1 -- 172.21.15.119:0/4169620889 reap_dead start 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff4d40676b0 msgr2=0x7ff4d4069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff4d40676b0 0x7ff4d4069b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009980 tx=0x7ff4e40090e0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 msgr2=0x7ff4f413bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 --2- 172.21.15.119:0/2085789395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f409ad50 0x7ff4f413bfc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b3e0 tx=0x7ff4e000b8a0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f3400640 1 -- 172.21.15.119:0/2085789395 reap_dead start 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 shutdown_connections 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 >> 172.21.15.119:0/2085789395 conn(0x7ff4f409a230 msgr2=0x7ff4f40b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 shutdown_connections 2024-03-08T21:33:55.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.179+0000 7ff4f9800640 1 -- 172.21.15.119:0/2085789395 wait complete. 2024-03-08T21:33:55.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.183+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 shutdown_connections 2024-03-08T21:33:55.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.183+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 >> 172.21.15.119:0/4169620889 conn(0x7f3db80b8520 msgr2=0x7f3db80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.183+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 shutdown_connections 2024-03-08T21:33:55.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.183+0000 7f3dbec00640 1 -- 172.21.15.119:0/4169620889 wait complete. 2024-03-08T21:33:55.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 --> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e28002de0 con 0x7f5e3006f860 2024-03-08T21:33:55.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 --> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9540c8ce0 con 0x7fd93c06f9b0 2024-03-08T21:33:55.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e46a00640 1 -- 172.21.15.119:0/4070929464 <== osd.6 v2:172.21.15.160:6824/2462175977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e28002de0 con 0x7f5e3006f860 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5e3006f860 msgr2=0x7f5e30071c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5e3006f860 0x7f5e30071c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7fd94fe00640 1 -- 172.21.15.119:0/839929533 <== osd.7 v2:172.21.15.160:6808/1919516380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9540c8ce0 con 0x7fd93c06f9b0 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5e30067660 msgr2=0x7f5e30069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5e30067660 0x7f5e30069b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0ad000 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 msgr2=0x7f5e480221f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 --2- 172.21.15.119:0/4070929464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e4800c360 0x7f5e480221f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c490 tx=0x7f5e40001e80 comp rx=0 tx=0).stop 2024-03-08T21:33:55.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4f400640 1 -- 172.21.15.119:0/4070929464 reap_dead start 2024-03-08T21:33:55.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 shutdown_connections 2024-03-08T21:33:55.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 >> 172.21.15.119:0/4070929464 conn(0x7f5e4800b5e0 msgr2=0x7f5e4803a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 shutdown_connections 2024-03-08T21:33:55.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.195+0000 7f5e4fe00640 1 -- 172.21.15.119:0/4070929464 wait complete. 2024-03-08T21:33:55.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7fd93c06f9b0 msgr2=0x7fd93c071dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7fd93c06f9b0 0x7fd93c071dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd93c067730 msgr2=0x7fd93c069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd93c067730 0x7fd93c069bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ad000 tx=0x7fd950004710 comp rx=0 tx=0).stop 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 msgr2=0x7fd9540bb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 --2- 172.21.15.119:0/839929533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd954161890 0x7fd9540bb7b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd95c073bf0 tx=0x7fd95c04f5d0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd960c00640 1 -- 172.21.15.119:0/839929533 reap_dead start 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 shutdown_connections 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 >> 172.21.15.119:0/839929533 conn(0x7fd95403a860 msgr2=0x7fd9540c2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 shutdown_connections 2024-03-08T21:33:55.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.199+0000 7fd961600640 1 -- 172.21.15.119:0/839929533 wait complete. 2024-03-08T21:33:55.208 INFO:teuthology.orchestra.run.smithi119.stdout:64424509447 2024-03-08T21:33:55.208 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-08T21:33:55.209 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-03-08T21:33:55.209 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-08T21:33:55.210 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-03-08T21:33:55.210 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-08T21:33:55.211 INFO:teuthology.orchestra.run.smithi119.stdout:60129542150 2024-03-08T21:33:55.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-08T21:33:55.213 INFO:teuthology.orchestra.run.smithi119.stdout:64424509447 2024-03-08T21:33:55.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-08T21:33:55.214 INFO:teuthology.orchestra.run.smithi119.stdout:60129542151 2024-03-08T21:33:55.214 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-08T21:33:55.217 INFO:teuthology.orchestra.run.smithi119.stdout:64424509448 2024-03-08T21:33:55.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-08T21:33:55.225 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-03-08T21:33:55.225 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-08T21:33:55.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.459+0000 7f42f9c00640 1 Processor -- start 2024-03-08T21:33:55.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.459+0000 7f71c3200640 1 Processor -- start 2024-03-08T21:33:55.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 -- start start 2024-03-08T21:33:55.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f42f40adc70 0x7f42f40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 -- start start 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 0x7f71bc0b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71bc06d6b0 0x7f71bc0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc146590 con 0x7f71bc147070 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc146be0 con 0x7f71bc0adc70 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71c3200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc0b3350 con 0x7f71bc06d6b0 2024-03-08T21:33:55.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 Processor -- start 2024-03-08T21:33:55.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71bb400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71bc06d6b0 0x7f71bc0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71bb400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f71bc06d6b0 0x7f71bc0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35420/0 (socket says 172.21.15.119:35420) 2024-03-08T21:33:55.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71bb400640 1 -- 172.21.15.119:0/3859864309 learned_addr learned my addr 172.21.15.119:0/3859864309 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 -- start start 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f42f40b5a30 0x7f42f413d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f4146590 con 0x7f42f406d6b0 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f4146be0 con 0x7f42f40b5a30 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f9c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40b3350 con 0x7f42f40adc70 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f2000640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f42f406d6b0 0x7f42f413cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37018/0 (socket says 172.21.15.119:37018) 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f2000640 1 -- 172.21.15.119:0/1798861289 learned_addr learned my addr 172.21.15.119:0/1798861289 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f2a00640 1 --2- 172.21.15.119:0/1798861289 >> v2:172.21.15.160:3300/0 conn(0x7f42f40adc70 0x7f42f40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f1600640 1 -- 172.21.15.119:0/1798861289 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422209567 0 0) 0x7f42f4146590 con 0x7f42f406d6b0 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f42f1600640 1 -- 172.21.15.119:0/1798861289 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d8003530 con 0x7f42f406d6b0 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 0x7f47d81465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f47d8146b10 0x7f47d814d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80b3b20 con 0x7f47d813d410 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d806d0f0 con 0x7f47d8146b10 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f47df400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d813d7f0 con 0x7f47d80b2f20 2024-03-08T21:33:55.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.463+0000 7f71bb400640 1 -- 172.21.15.119:0/3859864309 >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 msgr2=0x7f71bc0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47dca00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f47d813d410 0x7f47d806c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37030/0 (socket says 172.21.15.119:37030) 2024-03-08T21:33:55.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47dca00640 1 -- 172.21.15.119:0/1894230870 learned_addr learned my addr 172.21.15.119:0/1894230870 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47dd400640 1 --2- 172.21.15.119:0/1894230870 >> v2:172.21.15.160:3300/0 conn(0x7f47d8146b10 0x7f47d814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71bbe00640 1 --2- 172.21.15.119:0/3859864309 >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 0x7f71bc0b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7e00640 1 --2- 172.21.15.119:0/1894230870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 0x7f47d81465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f42f3400640 1 --2- 172.21.15.119:0/1798861289 >> v2:172.21.15.119:3300/0 conn(0x7f42f40b5a30 0x7f42f413d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71baa00640 1 -- 172.21.15.119:0/3859864309 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315775559 0 0) 0x7f71bc146590 con 0x7f71bc147070 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f42f3400640 1 -- 172.21.15.119:0/1798861289 >> v2:172.21.15.160:3300/0 conn(0x7f42f40adc70 msgr2=0x7f42f40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f42f3400640 1 --2- 172.21.15.119:0/1798861289 >> v2:172.21.15.160:3300/0 conn(0x7f42f40adc70 0x7f42f40b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f42f3400640 1 -- 172.21.15.119:0/1798861289 >> v1:172.21.15.160:6789/0 conn(0x7f42f406d6b0 legacy=0x7f42f413cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f42f3400640 1 -- 172.21.15.119:0/1798861289 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4146870 con 0x7f42f40b5a30 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7e00640 1 -- 172.21.15.119:0/1894230870 >> v2:172.21.15.160:3300/0 conn(0x7f47d8146b10 msgr2=0x7f47d814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7400640 1 -- 172.21.15.119:0/1894230870 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501005175 0 0) 0x7f47d80b3b20 con 0x7f47d813d410 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7e00640 1 --2- 172.21.15.119:0/1894230870 >> v2:172.21.15.160:3300/0 conn(0x7f47d8146b10 0x7f47d814d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7e00640 1 -- 172.21.15.119:0/1894230870 >> v1:172.21.15.160:6789/0 conn(0x7f47d813d410 legacy=0x7f47d806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f47d7e00640 1 -- 172.21.15.119:0/1894230870 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80b4b50 con 0x7f47d80b2f20 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71bb400640 1 --2- 172.21.15.119:0/3859864309 >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 0x7f71bc0b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71bb400640 1 -- 172.21.15.119:0/3859864309 >> v1:172.21.15.119:6789/0 conn(0x7f71bc147070 legacy=0x7f71bc13cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71bb400640 1 -- 172.21.15.119:0/3859864309 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc146870 con 0x7f71bc06d6b0 2024-03-08T21:33:55.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.467+0000 7f71bbe00640 1 --2- 172.21.15.119:0/3859864309 >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 0x7f71bc0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:55.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.471+0000 7f42f3400640 1 --2- 172.21.15.119:0/1798861289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f40b5a30 0x7f42f413d250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42f40b5fd0 tx=0x7f42ec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5038ad86b12f5543 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.471+0000 7f42f1600640 1 -- 172.21.15.119:0/1798861289 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0b5070 con 0x7f42f40b5a30 2024-03-08T21:33:55.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.471+0000 7f42f1600640 1 -- 172.21.15.119:0/1798861289 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0a8970 con 0x7f42f40b5a30 2024-03-08T21:33:55.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.471+0000 7f42f1600640 1 -- 172.21.15.119:0/1798861289 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0a8d40 con 0x7f42f40b5a30 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- 172.21.15.119:0/1798861289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f40b5a30 msgr2=0x7f42f413d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 --2- 172.21.15.119:0/1798861289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f40b5a30 0x7f42f413d250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42f40b5fd0 tx=0x7f42ec01ec70 comp rx=0 tx=0).stop 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- 172.21.15.119:0/1798861289 shutdown_connections 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 --2- 172.21.15.119:0/1798861289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f40b5a30 0x7f42f413d250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 --2- 172.21.15.119:0/1798861289 >> v2:172.21.15.160:3300/0 conn(0x7f42f40adc70 0x7f42f40b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- 172.21.15.119:0/1798861289 >> 172.21.15.119:0/1798861289 conn(0x7f42f40b4f10 msgr2=0x7f42f40b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- 172.21.15.119:0/1798861289 shutdown_connections 2024-03-08T21:33:55.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- 172.21.15.119:0/1798861289 wait complete. 2024-03-08T21:33:55.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71bb400640 1 --2- 172.21.15.119:0/3859864309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc06d6b0 0x7f71bc0ae050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06ec20 tx=0x7f71ac01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6afb450e80fa17ac server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71baa00640 1 -- 172.21.15.119:0/3859864309 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0b5070 con 0x7f71bc06d6b0 2024-03-08T21:33:55.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71baa00640 1 -- 172.21.15.119:0/3859864309 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0a8a10 con 0x7f71bc06d6b0 2024-03-08T21:33:55.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71baa00640 1 -- 172.21.15.119:0/3859864309 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0a8de0 con 0x7f71bc06d6b0 2024-03-08T21:33:55.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f47d7e00640 1 --2- 172.21.15.119:0/1894230870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 0x7f47d81465d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47c80097c0 tx=0x7f47c801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=171c92bd4d59bca3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 Processor -- start 2024-03-08T21:33:55.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f42f9c00640 1 -- start start 2024-03-08T21:33:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71c3200640 1 -- 172.21.15.119:0/3859864309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc06d6b0 msgr2=0x7f71bc0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f47d7400640 1 -- 172.21.15.119:0/1894230870 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80b0070 con 0x7f47d80b2f20 2024-03-08T21:33:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f47d7400640 1 -- 172.21.15.119:0/1894230870 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80ab600 con 0x7f47d80b2f20 2024-03-08T21:33:55.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f47d7400640 1 -- 172.21.15.119:0/1894230870 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab9d0 con 0x7f47d80b2f20 2024-03-08T21:33:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71c3200640 1 --2- 172.21.15.119:0/3859864309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc06d6b0 0x7f71bc0ae050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71bc06ec20 tx=0x7f71ac01ed10 comp rx=0 tx=0).stop 2024-03-08T21:33:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71c3200640 1 -- 172.21.15.119:0/3859864309 shutdown_connections 2024-03-08T21:33:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.475+0000 7f71c3200640 1 --2- 172.21.15.119:0/3859864309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc06d6b0 0x7f71bc0ae050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f71c3200640 1 --2- 172.21.15.119:0/3859864309 >> v2:172.21.15.119:3300/0 conn(0x7f71bc0adc70 0x7f71bc0b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f71c3200640 1 -- 172.21.15.119:0/3859864309 >> 172.21.15.119:0/3859864309 conn(0x7f71bc0b4f10 msgr2=0x7f71bc0b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 0x7f42f41422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f40adc70 0x7f42f41427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40af2d0 con 0x7f42f406d6b0 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41472c0 con 0x7f42f40adc70 2024-03-08T21:33:55.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f9c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40ae050 con 0x7f42f40b5a30 2024-03-08T21:33:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 Processor -- start 2024-03-08T21:33:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 -- 172.21.15.119:0/1894230870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 msgr2=0x7f47d81465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 --2- 172.21.15.119:0/1894230870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 0x7f47d81465d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47c80097c0 tx=0x7f47c801c410 comp rx=0 tx=0).stop 2024-03-08T21:33:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 -- start start 2024-03-08T21:33:55.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f71c3200640 1 -- 172.21.15.119:0/3859864309 shutdown_connections 2024-03-08T21:33:55.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f71c3200640 1 -- 172.21.15.119:0/3859864309 wait complete. 2024-03-08T21:33:55.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 -- 172.21.15.119:0/1894230870 shutdown_connections 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 --2- 172.21.15.119:0/1894230870 >> v2:172.21.15.160:3300/0 conn(0x7f47d8146b10 0x7f47d814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 --2- 172.21.15.119:0/1894230870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d80b2f20 0x7f47d81465d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 -- 172.21.15.119:0/1894230870 >> 172.21.15.119:0/1894230870 conn(0x7f47d80b8520 msgr2=0x7f47d80b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 -- 172.21.15.119:0/1894230870 shutdown_connections 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f2000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f40adc70 0x7f42f41427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f47df400640 1 -- 172.21.15.119:0/1894230870 wait complete. 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37622/0 (socket says 172.21.15.119:37622) 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 -- 172.21.15.119:0/2749945746 learned_addr learned my addr 172.21.15.119:0/2749945746 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 -- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f40adc70 msgr2=0x7f42f41427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8ab40b4880 0x7f8ab4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40b3f40 con 0x7f8ab414eb70 2024-03-08T21:33:55.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab40b55d0 con 0x7f8ab40b4fa0 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab9000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab40b7120 con 0x7f8ab40b4880 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f2a00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 0x7f42f41422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f40adc70 0x7f42f41427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 -- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 msgr2=0x7f42f41422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 0x7f42f41422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 -- 172.21.15.119:0/2749945746 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4141690 con 0x7f42f40b5a30 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f2a00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 0x7f42f41422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:55.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42f3400640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0b3040 tx=0x7f42ec01ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab2800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8ab40b4880 0x7f8ab4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab1400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f8ab40b4fa0 0x7f8ab414ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37044/0 (socket says 172.21.15.119:37044) 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f8ab1400640 1 -- 172.21.15.119:0/2789495238 learned_addr learned my addr 172.21.15.119:0/2789495238 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 Processor -- start 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 -- start start 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5b300b5650 0x7f5b30143e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3009c4b0 con 0x7f5b3006df30 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3009c790 con 0x7f5b300b2f20 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b35400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3009cb00 con 0x7f5b300b5650 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 Processor -- start 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0bd070 con 0x7f42f40b5a30 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0b0640 con 0x7f42f40b5a30 2024-03-08T21:33:55.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0b5040 con 0x7f42f40b5a30 2024-03-08T21:33:55.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b2e800640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5b300b2f20 0x7f5b300b4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37046/0 (socket says 172.21.15.119:37046) 2024-03-08T21:33:55.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.479+0000 7f5b2e800640 1 -- 172.21.15.119:0/2484336690 learned_addr learned my addr 172.21.15.119:0/2484336690 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 Processor -- start 2024-03-08T21:33:55.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 -- start start 2024-03-08T21:33:55.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 -- start start 2024-03-08T21:33:55.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5b2f200640 1 --2- 172.21.15.119:0/2484336690 >> v2:172.21.15.119:3300/0 conn(0x7f5b300b5650 0x7f5b30143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d80b2f20 0x7f47d8145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47d8146b10 0x7f47d8132680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8150a50 con 0x7f47d80b2f20 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d81508d0 con 0x7f47d8146b10 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47df400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8150bd0 con 0x7f47d813d410 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47dd400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47d8146b10 0x7f47d8132680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37628/0 (socket says 172.21.15.119:37628) 2024-03-08T21:33:55.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f47d7e00640 1 -- 172.21.15.119:0/653900544 learned_addr learned my addr 172.21.15.119:0/653900544 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52600b5390 0x7f526009cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526014c4d0 con 0x7f52600b4fb0 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52600b3940 con 0x7f52600b5390 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f5267a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600b3c20 con 0x7f526014bb00 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f8ab2800640 1 -- 172.21.15.119:0/2789495238 >> v1:172.21.15.160:6789/0 conn(0x7f8ab40b4fa0 legacy=0x7f8ab414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f8ab2800640 1 -- 172.21.15.119:0/2789495238 >> v1:172.21.15.119:6789/0 conn(0x7f8ab414eb70 legacy=0x7f8ab40b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f8ab2800640 1 -- 172.21.15.119:0/2789495238 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40b3ba0 con 0x7f8ab40b4880 2024-03-08T21:33:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41413b0 con 0x7f42f40b5a30 2024-03-08T21:33:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f40b1c00 con 0x7f42f40b5a30 2024-03-08T21:33:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.483+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f4075080 con 0x7f42f40b5a30 2024-03-08T21:33:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 -- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47d8146b10 msgr2=0x7f47d8132680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47d8146b10 0x7f47d8132680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 -- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d80b2f20 msgr2=0x7f47d8145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d80b2f20 0x7f47d8145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 -- 172.21.15.119:0/653900544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8145700 con 0x7f47d813d410 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37642/0 (socket says 172.21.15.119:37642) 2024-03-08T21:33:55.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 -- 172.21.15.119:0/3804748541 learned_addr learned my addr 172.21.15.119:0/3804748541 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d7e00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae040 tx=0x7f47c801ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f525fe00640 1 --2- 172.21.15.119:0/3804748541 >> v2:172.21.15.119:3300/0 conn(0x7f52600b5390 0x7f526009cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 -- 172.21.15.119:0/3804748541 >> v2:172.21.15.119:3300/0 conn(0x7f52600b5390 msgr2=0x7f526009cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 --2- 172.21.15.119:0/3804748541 >> v2:172.21.15.119:3300/0 conn(0x7f52600b5390 0x7f526009cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 -- 172.21.15.119:0/3804748541 >> v1:172.21.15.119:6789/0 conn(0x7f52600b4fb0 legacy=0x7f52600b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 Processor -- start 2024-03-08T21:33:55.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80b0050 con 0x7f47d813d410 2024-03-08T21:33:55.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80b1040 con 0x7f47d813d410 2024-03-08T21:33:55.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80b5a50 con 0x7f47d813d410 2024-03-08T21:33:55.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 -- start start 2024-03-08T21:33:55.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47df400640 1 -- 172.21.15.119:0/653900544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d812ff80 con 0x7f47d813d410 2024-03-08T21:33:55.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47df400640 1 -- 172.21.15.119:0/653900544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d8145420 con 0x7f47d813d410 2024-03-08T21:33:55.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f1e9c600640 1 Processor -- start 2024-03-08T21:33:55.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5265a00640 1 -- 172.21.15.119:0/3804748541 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526014b5e0 con 0x7f526014bb00 2024-03-08T21:33:55.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc0adc70 0x7f71bc13e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5b2f200640 1 -- 172.21.15.119:0/2484336690 >> v1:172.21.15.160:6789/0 conn(0x7f5b300b2f20 legacy=0x7f5b300b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5b2f200640 1 -- 172.21.15.119:0/2484336690 >> v1:172.21.15.119:6789/0 conn(0x7f5b3006df30 legacy=0x7f5b301436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5b2f200640 1 -- 172.21.15.119:0/2484336690 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300b5e50 con 0x7f5b300b5650 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f5b2d400640 1 -- 172.21.15.119:0/2484336690 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718313416 0 0) 0x7f5b3009c790 con 0x7f5b300b2f20 2024-03-08T21:33:55.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f1e9c600640 1 -- start start 2024-03-08T21:33:55.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 0x7f71bc1ec200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0af2d0 con 0x7f71bc147070 2024-03-08T21:33:55.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0b5c80 con 0x7f71bc0adc70 2024-03-08T21:33:55.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c3200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0ae590 con 0x7f71bc06d6b0 2024-03-08T21:33:55.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37646/0 (socket says 172.21.15.119:37646) 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 -- 172.21.15.119:0/1564304219 learned_addr learned my addr 172.21.15.119:0/1564304219 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c1200640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 0x7f71bc1ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f47df400640 1 -- 172.21.15.119:0/653900544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d8067db0 con 0x7f47d813d410 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 -- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc0adc70 msgr2=0x7f71bc13e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc0adc70 0x7f71bc13e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 -- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 msgr2=0x7f71bc1ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 0x7f71bc1ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71bbe00640 1 -- 172.21.15.119:0/1564304219 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc0b0780 con 0x7f71bc06d6b0 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.487+0000 7f71c1200640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 0x7f71bc1ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f42ec0c0070 con 0x7f42f40b5a30 2024-03-08T21:33:55.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f71bbe00640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c7c0 tx=0x7f71a800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9c600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 0x7f1e94072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9c600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1e9413ed00 0x7f1e9414f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab2800640 1 --2- 172.21.15.119:0/2789495238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab4156c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009dc0 tx=0x7f8aac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef30c08916ded41 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9c600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9406b740 con 0x7f1e940b5990 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9c600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9406e690 con 0x7f1e9413ed00 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9c600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406e970 con 0x7f1e940726b0 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99200640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f1e940b5990 0x7f1e9406b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37060/0 (socket says 172.21.15.119:37060) 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99200640 1 -- 172.21.15.119:0/1582545225 learned_addr learned my addr 172.21.15.119:0/1582545225 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99c00640 1 --2- 172.21.15.119:0/1582545225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 0x7f1e94072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f42eaa00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 0x7f42d4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab0a00640 1 -- 172.21.15.119:0/2789495238 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b1070 con 0x7f8ab40b4880 2024-03-08T21:33:55.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e9a600640 1 --2- 172.21.15.119:0/1582545225 >> v2:172.21.15.119:3300/0 conn(0x7f1e9413ed00 0x7f1e9414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab0a00640 1 -- 172.21.15.119:0/2789495238 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac0a4920 con 0x7f8ab40b4880 2024-03-08T21:33:55.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab0a00640 1 -- 172.21.15.119:0/2789495238 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b1070 con 0x7f8ab40b4880 2024-03-08T21:33:55.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99c00640 1 -- 172.21.15.119:0/1582545225 >> v2:172.21.15.119:3300/0 conn(0x7f1e9413ed00 msgr2=0x7f1e9414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42ec1229e0 con 0x7f42f40b5a30 2024-03-08T21:33:55.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99c00640 1 --2- 172.21.15.119:0/1582545225 >> v2:172.21.15.119:3300/0 conn(0x7f1e9413ed00 0x7f1e9414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99c00640 1 -- 172.21.15.119:0/1582545225 >> v1:172.21.15.160:6789/0 conn(0x7f1e940b5990 legacy=0x7f1e9406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f1e99c00640 1 -- 172.21.15.119:0/1582545225 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9406bb10 con 0x7f1e940726b0 2024-03-08T21:33:55.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f42f2a00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 0x7f42d4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f42f2a00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 0x7f42d4069bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f42e400ffd0 tx=0x7f42e4011040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f5b2f200640 1 --2- 172.21.15.119:0/2484336690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b300b5650 0x7f5b30143e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a960 tx=0x7f5b1c01d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374d2c1a79e10b2f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 -- 172.21.15.119:0/2789495238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 msgr2=0x7f8ab4156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 --2- 172.21.15.119:0/2789495238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab4156c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009dc0 tx=0x7f8aac01c450 comp rx=0 tx=0).stop 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 -- 172.21.15.119:0/2789495238 shutdown_connections 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 --2- 172.21.15.119:0/2789495238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab4156c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 -- 172.21.15.119:0/2789495238 >> 172.21.15.119:0/2789495238 conn(0x7f8ab4072c70 msgr2=0x7f8ab40bc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 -- 172.21.15.119:0/2789495238 shutdown_connections 2024-03-08T21:33:55.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f5b2d400640 1 -- 172.21.15.119:0/2484336690 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00b040 con 0x7f5b300b5650 2024-03-08T21:33:55.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f5b2d400640 1 -- 172.21.15.119:0/2484336690 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0a76c0 con 0x7f5b300b5650 2024-03-08T21:33:55.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f8ab9000640 1 -- 172.21.15.119:0/2789495238 wait complete. 2024-03-08T21:33:55.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f5b2d400640 1 -- 172.21.15.119:0/2484336690 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0a7a90 con 0x7f5b300b5650 2024-03-08T21:33:55.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.491+0000 7f5265a00640 1 --2- 172.21.15.119:0/3804748541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5258009e50 tx=0x7f525801c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4f94ee7c387fc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 -- 172.21.15.119:0/2484336690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b300b5650 msgr2=0x7f5b30143e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 --2- 172.21.15.119:0/2484336690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b300b5650 0x7f5b30143e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a960 tx=0x7f5b1c01d770 comp rx=0 tx=0).stop 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 -- 172.21.15.119:0/2484336690 shutdown_connections 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 --2- 172.21.15.119:0/2484336690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b300b5650 0x7f5b30143e00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 -- 172.21.15.119:0/2484336690 >> 172.21.15.119:0/2484336690 conn(0x7f5b3006c620 msgr2=0x7f5b3006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 -- 172.21.15.119:0/2484336690 shutdown_connections 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 -- 172.21.15.119:0/2484336690 wait complete. 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 Processor -- start 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 -- start start 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f525f400640 1 -- 172.21.15.119:0/3804748541 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580a56e0 con 0x7f526014bb00 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f525f400640 1 -- 172.21.15.119:0/3804748541 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580a5880 con 0x7f526014bb00 2024-03-08T21:33:55.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f525f400640 1 -- 172.21.15.119:0/3804748541 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580a5c50 con 0x7f526014bb00 2024-03-08T21:33:55.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ab40b4fa0 0x7f8ab41e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f42ec0187f0 con 0x7f42f40b5a30 2024-03-08T21:33:55.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8007a30 con 0x7f71bc06d6b0 2024-03-08T21:33:55.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8007bd0 con 0x7f71bc06d6b0 2024-03-08T21:33:55.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 0x7f8ab41e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab415a7f0 con 0x7f8ab414eb70 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab415a970 con 0x7f8ab40b4880 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab9000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab415aaf0 con 0x7f8ab40b4fa0 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab1e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab1400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ab40b4fa0 0x7f8ab41e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab1e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35472/0 (socket says 172.21.15.119:35472) 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab1e00640 1 -- 172.21.15.119:0/3300400969 learned_addr learned my addr 172.21.15.119:0/3300400969 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 0x7f8ab41e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f1e99c00640 1 --2- 172.21.15.119:0/1582545225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 0x7f1e94072a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097c0 tx=0x7f1e8001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf2017374b44e4b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 -- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ab40b4fa0 msgr2=0x7f8ab41e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ab40b4fa0 0x7f8ab41e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 -- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 msgr2=0x7f8ab406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 -- 172.21.15.119:0/3300400969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab406f8b0 con 0x7f8ab414eb70 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80113f0 con 0x7f71bc06d6b0 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f71c3200640 1 -- 172.21.15.119:0/1564304219 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc0b2650 con 0x7f71bc06d6b0 2024-03-08T21:33:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f71c3200640 1 -- 172.21.15.119:0/1564304219 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc0b0f00 con 0x7f71bc06d6b0 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f47c80b5bf0 con 0x7f47d813d410 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8ab2800640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 0x7f8ab41e5110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ab000 tx=0x7f8aac019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0bc020 con 0x7f8ab414eb70 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac004040 con 0x7f8ab414eb70 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0b1040 con 0x7f8ab414eb70 2024-03-08T21:33:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.495+0000 7f5b35400640 1 Processor -- start 2024-03-08T21:33:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 -- 172.21.15.119:0/3804748541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 msgr2=0x7f526014bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 --2- 172.21.15.119:0/3804748541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5258009e50 tx=0x7f525801c910 comp rx=0 tx=0).stop 2024-03-08T21:33:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f47d4c00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 0x7f47b8069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab4071440 con 0x7f8ab414eb70 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 -- 172.21.15.119:0/3804748541 shutdown_connections 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 --2- 172.21.15.119:0/3804748541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f526014bf90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 --2- 172.21.15.119:0/3804748541 >> v2:172.21.15.119:3300/0 conn(0x7f52600b5390 0x7f526009cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 -- 172.21.15.119:0/3804748541 >> 172.21.15.119:0/3804748541 conn(0x7f526006c620 msgr2=0x7f526006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71900052a0 con 0x7f71bc06d6b0 2024-03-08T21:33:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4148e50 con 0x7f8ab414eb70 2024-03-08T21:33:55.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47c8123f00 con 0x7f47d813d410 2024-03-08T21:33:55.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 -- 172.21.15.119:0/3804748541 shutdown_connections 2024-03-08T21:33:55.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f47dca00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 0x7f47b8069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5267a00640 1 -- 172.21.15.119:0/3804748541 wait complete. 2024-03-08T21:33:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f47dca00640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 0x7f47b8069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47d0001570 tx=0x7f47d0007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f1e93e00640 1 -- 172.21.15.119:0/1582545225 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800b1070 con 0x7f1e940726b0 2024-03-08T21:33:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f1e93e00640 1 -- 172.21.15.119:0/1582545225 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800ac410 con 0x7f1e940726b0 2024-03-08T21:33:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f1e93e00640 1 -- 172.21.15.119:0/1582545225 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800ac7e0 con 0x7f1e940726b0 2024-03-08T21:33:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab4067db0 con 0x7f8ab414eb70 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f5b35400640 1 -- start start 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 0x7f5b3006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 0x7f5b3014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b30070000 0x7f5b3014d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b30151640 con 0x7f5b30070000 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301514c0 con 0x7f5b3006df30 2024-03-08T21:33:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b35400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301517c0 con 0x7f5b300b5650 2024-03-08T21:33:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5267a00640 1 Processor -- start 2024-03-08T21:33:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8aac0bf020 con 0x7f8ab414eb70 2024-03-08T21:33:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f8aaa000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 0x7f8a94069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aac11f7c0 con 0x7f8ab414eb70 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.499+0000 7f1e9c600640 1 -- 172.21.15.119:0/1582545225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 msgr2=0x7f1e94072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f1e9c600640 1 --2- 172.21.15.119:0/1582545225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 0x7f1e94072a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e800097c0 tx=0x7f1e8001c410 comp rx=0 tx=0).stop 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f1e9c600640 1 -- 172.21.15.119:0/1582545225 shutdown_connections 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f1e9c600640 1 --2- 172.21.15.119:0/1582545225 >> v2:172.21.15.119:3300/0 conn(0x7f1e9413ed00 0x7f1e9414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f1e9c600640 1 --2- 172.21.15.119:0/1582545225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940726b0 0x7f1e94072a90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f1e9c600640 1 -- 172.21.15.119:0/1582545225 >> 172.21.15.119:0/1582545225 conn(0x7f1e940b60c0 msgr2=0x7f1e940b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f47c80cf080 con 0x7f47d813d410 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 0x7f5b3006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2e800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 0x7f5b3006fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35488/0 (socket says 172.21.15.119:35488) 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2e800640 1 -- 172.21.15.119:0/3815506866 learned_addr learned my addr 172.21.15.119:0/3815506866 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 0x7f5b3014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2f200640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b30070000 0x7f5b3014d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f8ab1e00640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 0x7f8a94069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 -- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 msgr2=0x7f5b3006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 0x7f5b3006fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 -- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b30070000 msgr2=0x7f5b3014d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b30070000 0x7f5b3014d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 -- 172.21.15.119:0/3815506866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30070f80 con 0x7f5b300b5650 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5267a00640 1 -- start start 2024-03-08T21:33:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b2de00640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 0x7f5b3014cc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006e350 tx=0x7f5b2000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f8ab1e00640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 0x7f8a94069b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0001810 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20017070 con 0x7f5b300b5650 2024-03-08T21:33:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200052d0 con 0x7f5b300b5650 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f71a8011590 con 0x7f71bc06d6b0 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f71b3e00640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 0x7f719c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71a8085f40 con 0x7f71bc06d6b0 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f71bb400640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 0x7f719c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f1e9c600640 1 -- 172.21.15.119:0/1582545225 shutdown_connections 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.503+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20003820 con 0x7f5b300b5650 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b30071260 con 0x7f5b300b5650 2024-03-08T21:33:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b30070c70 con 0x7f5b300b5650 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f1e9c600640 1 -- 172.21.15.119:0/1582545225 wait complete. 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600b4fb0 0x7f52601f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52600b5390 0x7f52601ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52601588b0 con 0x7f52600b4fb0 2024-03-08T21:33:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526009d610 con 0x7f52600b5390 2024-03-08T21:33:55.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5267a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5260158a30 con 0x7f526014bb00 2024-03-08T21:33:55.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f71bb400640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 0x7f719c069b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b2000 tx=0x7f71ac004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30067db0 con 0x7f5b300b5650 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37672/0 (socket says 172.21.15.119:37672) 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 -- 172.21.15.119:0/1845349359 learned_addr learned my addr 172.21.15.119:0/1845349359 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265000640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600b4fb0 0x7f52601f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f525fe00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52600b5390 0x7f52601ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 -- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52600b5390 msgr2=0x7f52601ebf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52600b5390 0x7f52601ebf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 -- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600b4fb0 msgr2=0x7f52601f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600b4fb0 0x7f52601f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 -- 172.21.15.119:0/1845349359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52601ef580 con 0x7f526014bb00 2024-03-08T21:33:55.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5b2001a070 con 0x7f5b300b5650 2024-03-08T21:33:55.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f1e9c600640 1 Processor -- start 2024-03-08T21:33:55.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5265a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525801a540 tx=0x7f52580196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b26a00640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 0x7f5b10069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b20084a30 con 0x7f5b300b5650 2024-03-08T21:33:55.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f71a8015020 con 0x7f71bc06d6b0 2024-03-08T21:33:55.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f5b2e800640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 0x7f5b10069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.507+0000 7f1e9c600640 1 -- start start 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 0x7f1e9414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 0x7f1e94141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 0x7f1e941e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940ae760 con 0x7f1e940b5990 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940ae5e0 con 0x7f1e940726b0 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9c600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940ae8e0 con 0x7f1e9413ed00 2024-03-08T21:33:55.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f5b2e800640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 0x7f5b10069b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b28005fd0 tx=0x7f5b28005c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e99c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 0x7f1e9414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e99c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 0x7f1e9414eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35518/0 (socket says 172.21.15.119:35518) 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e99c00640 1 -- 172.21.15.119:0/2342269915 learned_addr learned my addr 172.21.15.119:0/2342269915 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e99200640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 0x7f1e94141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 0x7f1e941e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 -- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 msgr2=0x7f1e9414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 0x7f1e9414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 -- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 msgr2=0x7f1e94141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 0x7f1e94141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 -- 172.21.15.119:0/2342269915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9413f6a0 con 0x7f1e9413ed00 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e99200640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 0x7f1e94141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f8aac0c6070 con 0x7f8ab414eb70 2024-03-08T21:33:55.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f1e9a600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 0x7f1e941e7580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00eba0 tx=0x7f1e8c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580bc070 con 0x7f526014bb00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580b8660 con 0x7f526014bb00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.511+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580b8a50 con 0x7f526014bb00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52601eceb0 con 0x7f526014bb00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52601ef820 con 0x7f526014bb00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c018020 con 0x7f1e9413ed00 2024-03-08T21:33:55.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c00cd20 con 0x7f1e9413ed00 2024-03-08T21:33:55.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0146c0 con 0x7f1e9413ed00 2024-03-08T21:33:55.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5260067db0 con 0x7f526014bb00 2024-03-08T21:33:55.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f5b20005480 con 0x7f5b300b5650 2024-03-08T21:33:55.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e941416c0 con 0x7f1e9413ed00 2024-03-08T21:33:55.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e940b3050 con 0x7f1e9413ed00 2024-03-08T21:33:55.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f52580bf070 con 0x7f526014bb00 2024-03-08T21:33:55.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.515+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94067db0 con 0x7f1e9413ed00 2024-03-08T21:33:55.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f525cc00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 0x7f5240069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5258120840 con 0x7f526014bb00 2024-03-08T21:33:55.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f5265000640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 0x7f5240069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f52580c6030 con 0x7f526014bb00 2024-03-08T21:33:55.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.519+0000 7f5265000640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 0x7f5240069ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f524c001770 tx=0x7f524c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.523+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1e8c01b020 con 0x7f1e9413ed00 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.523+0000 7f1e91600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 0x7f1e74069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.523+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e8c086a10 con 0x7f1e9413ed00 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.527+0000 7f1e99c00640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 0x7f1e74069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.527+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1e8c022020 con 0x7f1e9413ed00 2024-03-08T21:33:55.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.527+0000 7f1e99c00640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 0x7f1e74069bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e8001aac0 tx=0x7f1e800a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3be00640 1 Processor -- start 2024-03-08T21:33:55.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3be00640 1 -- start start 2024-03-08T21:33:55.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3aa00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6a3c09ad20 0x7f6a3c1463c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50984/0 (socket says 172.21.15.119:50984) 2024-03-08T21:33:55.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3aa00640 1 -- 172.21.15.119:0/109905484 learned_addr learned my addr 172.21.15.119:0/109905484 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:55.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3be00640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13cde0 0x7f6a3c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.543+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c146c20 con 0x7f6a3c09ad20 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827922858 0 0) 0x7f6a3c146c20 con 0x7f6a3c09ad20 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13cde0 0x7f6a3c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c146f00 con 0x7f6a3c13d240 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c06dcc0 con 0x7f6a3c13cde0 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a20003530 con 0x7f6a3c09ad20 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359877134 0 0) 0x7f6a3c146f00 con 0x7f6a3c13d240 2024-03-08T21:33:55.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3c146c20 con 0x7f6a3c13d240 2024-03-08T21:33:55.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378687332 0 0) 0x7f6a20003530 con 0x7f6a3c09ad20 2024-03-08T21:33:55.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13cde0 msgr2=0x7f6a3c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13cde0 0x7f6a3c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 >> v1:172.21.15.160:6789/0 conn(0x7f6a3c13d240 legacy=0x7f6a3c0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c1471e0 con 0x7f6a3c09ad20 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f6a24001680 con 0x7f6a3c09ad20 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 >> v1:172.21.15.119:6789/0 conn(0x7f6a3c09ad20 legacy=0x7f6a3c1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a20004c30 0x7f6a20005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a20003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a200099c0 0x7f6a20004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c06dcc0 con 0x7f6a200037b0 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200147c0 con 0x7f6a200099c0 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200149c0 con 0x7f6a20004c30 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3b400640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a200099c0 0x7f6a20004170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3aa00640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a20004c30 0x7f6a20005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a20003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 -- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a20004c30 msgr2=0x7f6a20005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a20004c30 0x7f6a20005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 -- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a200099c0 msgr2=0x7f6a20004170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:55.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.547+0000 7f6a3a000640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a200099c0 0x7f6a20004170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.551+0000 7f6a3a000640 1 -- 172.21.15.119:0/109905484 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20003530 con 0x7f6a200037b0 2024-03-08T21:33:55.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a3a000640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a20003c30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c06efa0 tx=0x7f6a2c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3290e7504441c5f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b2070 con 0x7f6a200037b0 2024-03-08T21:33:55.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a5520 con 0x7f6a200037b0 2024-03-08T21:33:55.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 msgr2=0x7f6a20003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a39600640 1 -- 172.21.15.119:0/109905484 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b2070 con 0x7f6a200037b0 2024-03-08T21:33:55.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a3be00640 1 --2- 172.21.15.119:0/109905484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a20003c30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c06efa0 tx=0x7f6a2c01c950 comp rx=0 tx=0).stop 2024-03-08T21:33:55.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.555+0000 7f6a3b400640 1 -- 172.21.15.119:0/109905484 reap_dead start 2024-03-08T21:33:55.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.559+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 shutdown_connections 2024-03-08T21:33:55.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.559+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 >> 172.21.15.119:0/109905484 conn(0x7f6a3c09a230 msgr2=0x7f6a3c09a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.563+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 shutdown_connections 2024-03-08T21:33:55.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.563+0000 7f6a3be00640 1 -- 172.21.15.119:0/109905484 wait complete. 2024-03-08T21:33:55.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.563+0000 7f6a3be00640 1 Processor -- start 2024-03-08T21:33:55.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 -- start start 2024-03-08T21:33:55.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a3c072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a3c072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35536/0 (socket says 172.21.15.119:35536) 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 -- 172.21.15.119:0/2621128602 learned_addr learned my addr 172.21.15.119:0/2621128602 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 0x7f6a3c0701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b6670 con 0x7f6a200037b0 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b4d20 con 0x7f6a3c13e190 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3be00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b67f0 con 0x7f6a3c13e5f0 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3b400640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 0x7f6a3c0701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 -- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 msgr2=0x7f6a3c0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 0x7f6a3c0701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 -- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 msgr2=0x7f6a3c072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a3c072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3a000640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c13eb10 con 0x7f6a3c13e190 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.567+0000 7f6a3b400640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 0x7f6a3c0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:55.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a3a000640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c098340 tx=0x7f6a20005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0b2040 con 0x7f6a3c13e190 2024-03-08T21:33:55.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0c7440 con 0x7f6a3c13e190 2024-03-08T21:33:55.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c009650 con 0x7f6a3c13e190 2024-03-08T21:33:55.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a3be00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c13db20 con 0x7f6a3c13e190 2024-03-08T21:33:55.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.571+0000 7f6a3be00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c1dc0f0 con 0x7f6a3c13e190 2024-03-08T21:33:55.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.575+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6a2c0c77f0 con 0x7f6a3c13e190 2024-03-08T21:33:55.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.575+0000 7f6a33400640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 0x7f6a18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:55.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.575+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a2c131100 con 0x7f6a3c13e190 2024-03-08T21:33:55.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.575+0000 7f6a3aa00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 0x7f6a18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:55.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.575+0000 7f6a3aa00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 0x7f6a18069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000c10 tx=0x7f6a24001610 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:55.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.579+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c13d930 con 0x7f6a3c13e190 2024-03-08T21:33:55.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.587+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f6a2c016660 con 0x7f6a3c13e190 2024-03-08T21:33:55.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.831+0000 7f47df400640 1 -- 172.21.15.119:0/653900544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f47d80b89a0 con 0x7f47d813d410 2024-03-08T21:33:55.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.831+0000 7f47d4c00640 1 -- 172.21.15.119:0/653900544 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47c8016090 con 0x7f47d813d410 2024-03-08T21:33:55.816 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-03-08T21:33:55.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 msgr2=0x7f47b8069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 0x7f47b8069bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47d0001570 tx=0x7f47d0007cb0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 msgr2=0x7f47d8132140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ae040 tx=0x7f47c801ac50 comp rx=0 tx=0).stop 2024-03-08T21:33:55.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 shutdown_connections 2024-03-08T21:33:55.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f47b8067730 0x7f47b8069bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47d8146b10 0x7f47d8132680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f47d813d410 0x7f47d8132140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 --2- 172.21.15.119:0/653900544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d80b2f20 0x7f47d8145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 >> 172.21.15.119:0/653900544 conn(0x7f47d80b8520 msgr2=0x7f47d813b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 shutdown_connections 2024-03-08T21:33:55.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.835+0000 7f47ce000640 1 -- 172.21.15.119:0/653900544 wait complete. 2024-03-08T21:33:55.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.839+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7190005860 con 0x7f71bc06d6b0 2024-03-08T21:33:55.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.839+0000 7f71b3e00640 1 -- 172.21.15.119:0/1564304219 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71a8056ba0 con 0x7f71bc06d6b0 2024-03-08T21:33:55.826 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-03-08T21:33:55.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.843+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f42f4144c10 con 0x7f42f40b5a30 2024-03-08T21:33:55.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.843+0000 7f42eaa00640 1 -- 172.21.15.119:0/2749945746 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42ec0f3080 con 0x7f42f40b5a30 2024-03-08T21:33:55.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 msgr2=0x7f719c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 0x7f719c069b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b2000 tx=0x7f71ac004740 comp rx=0 tx=0).stop 2024-03-08T21:33:55.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 msgr2=0x7f71bc0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c7c0 tx=0x7f71a800cc80 comp rx=0 tx=0).stop 2024-03-08T21:33:55.833 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-03-08T21:33:55.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 msgr2=0x7f42d4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 0x7f42d4069bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f42e400ffd0 tx=0x7f42e4011040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 msgr2=0x7f42f41db7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0b3040 tx=0x7f42ec01ba30 comp rx=0 tx=0).stop 2024-03-08T21:33:55.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 shutdown_connections 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f719c067660 0x7f719c069b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71bc147070 0x7f71bc1ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc0adc70 0x7f71bc13e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 --2- 172.21.15.119:0/1564304219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71bc06d6b0 0x7f71bc0b09c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 >> 172.21.15.119:0/1564304219 conn(0x7f71bc0b4f10 msgr2=0x7f71bc0b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b3014dac0 con 0x7f5b300b5650 2024-03-08T21:33:55.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 shutdown_connections 2024-03-08T21:33:55.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f42d4067730 0x7f42d4069bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42f40b5a30 0x7f42f41db7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b26a00640 1 -- 172.21.15.119:0/3815506866 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b200550d0 con 0x7f5b300b5650 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f40adc70 0x7f42f41427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 --2- 172.21.15.119:0/2749945746 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42f406d6b0 0x7f42f41422a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 >> 172.21.15.119:0/2749945746 conn(0x7f42f40b4f10 msgr2=0x7f42f4145130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 shutdown_connections 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f42f9c00640 1 -- 172.21.15.119:0/2749945746 wait complete. 2024-03-08T21:33:55.837 INFO:teuthology.orchestra.run.smithi119.stdout:60129542148 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.847+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 shutdown_connections 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f71b1600640 1 -- 172.21.15.119:0/1564304219 wait complete. 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 msgr2=0x7f5b10069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 0x7f5b10069b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b28005fd0 tx=0x7f5b28005c20 comp rx=0 tx=0).stop 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 msgr2=0x7f5b3014cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 0x7f5b3014cc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006e350 tx=0x7f5b2000c820 comp rx=0 tx=0).stop 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 shutdown_connections 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5b100676b0 0x7f5b10069b70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b30070000 0x7f5b3014d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b300b5650 0x7f5b3014cc50 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006e350 tx=0x7f5b2000c820 comp rx=0 tx=0).stop 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 --2- 172.21.15.119:0/3815506866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3006df30 0x7f5b3006fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 >> 172.21.15.119:0/3815506866 conn(0x7f5b3006c620 msgr2=0x7f5b300b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ab40baa60 con 0x7f8ab414eb70 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 shutdown_connections 2024-03-08T21:33:55.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.851+0000 7f5b35400640 1 -- 172.21.15.119:0/3815506866 wait complete. 2024-03-08T21:33:55.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.855+0000 7f8aaa000640 1 -- 172.21.15.119:0/3300400969 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8aac0164c0 con 0x7f8ab414eb70 2024-03-08T21:33:55.842 INFO:teuthology.orchestra.run.smithi119.stdout:60129542149 2024-03-08T21:33:55.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 msgr2=0x7f8a94069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 0x7f8a94069b20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0001810 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 msgr2=0x7f8ab41e5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 0x7f8ab41e5110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0ab000 tx=0x7f8aac019510 comp rx=0 tx=0).stop 2024-03-08T21:33:55.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 shutdown_connections 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8a94067660 0x7f8a94069b20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab414eb70 0x7f8ab41e5110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ab40b4fa0 0x7f8ab41e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 --2- 172.21.15.119:0/3300400969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ab40b4880 0x7f8ab406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 >> 172.21.15.119:0/3300400969 conn(0x7f8ab4072c70 msgr2=0x7f8ab40b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 shutdown_connections 2024-03-08T21:33:55.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f8ab9000640 1 -- 172.21.15.119:0/3300400969 wait complete. 2024-03-08T21:33:55.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.859+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1e94143600 con 0x7f1e9413ed00 2024-03-08T21:33:55.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.863+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f526006bf50 con 0x7f526014bb00 2024-03-08T21:33:55.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.863+0000 7f1e91600640 1 -- 172.21.15.119:0/2342269915 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e8c010040 con 0x7f1e9413ed00 2024-03-08T21:33:55.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.863+0000 7f525cc00640 1 -- 172.21.15.119:0/1845349359 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5258016620 con 0x7f526014bb00 2024-03-08T21:33:55.848 INFO:teuthology.orchestra.run.smithi119.stdout:64424509445 2024-03-08T21:33:55.848 INFO:teuthology.orchestra.run.smithi119.stdout:64424509447 2024-03-08T21:33:55.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 msgr2=0x7f1e74069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 0x7f1e74069bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e8001aac0 tx=0x7f1e800a6040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 msgr2=0x7f1e941e7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 0x7f1e941e7580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00eba0 tx=0x7f1e8c00c490 comp rx=0 tx=0).stop 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 msgr2=0x7f5240069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 shutdown_connections 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1e74067730 0x7f1e74069bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e9413ed00 0x7f1e941e7580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e940b5990 0x7f1e94141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 --2- 172.21.15.119:0/2342269915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e940726b0 0x7f1e9414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 >> 172.21.15.119:0/2342269915 conn(0x7f1e940b60c0 msgr2=0x7f1e94139f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 0x7f5240069ba0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f524c001770 tx=0x7f524c009040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 msgr2=0x7f5260147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525801a540 tx=0x7f52580196b0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 shutdown_connections 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f52400676e0 0x7f5240069ba0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f524c001770 tx=0x7f524c009040 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f526014bb00 0x7f5260147dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52600b5390 0x7f52601ebf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 --2- 172.21.15.119:0/1845349359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600b4fb0 0x7f52601f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 >> 172.21.15.119:0/1845349359 conn(0x7f526006c620 msgr2=0x7f526014adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 shutdown_connections 2024-03-08T21:33:55.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f5267a00640 1 -- 172.21.15.119:0/1845349359 wait complete. 2024-03-08T21:33:55.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 shutdown_connections 2024-03-08T21:33:55.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.867+0000 7f1e9c600640 1 -- 172.21.15.119:0/2342269915 wait complete. 2024-03-08T21:33:55.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-03-08T21:33:55.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2024-03-08T21:33:55.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2024-03-08T21:33:55.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-03-08T21:33:55.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-03-08T21:33:55.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-03-08T21:33:55.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2024-03-08T21:33:55.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6a3c075080 con 0x7f6a3c13e190 2024-03-08T21:33:55.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a33400640 1 -- 172.21.15.119:0/2621128602 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a2c101840 con 0x7f6a3c13e190 2024-03-08T21:33:55.896 INFO:teuthology.orchestra.run.smithi119.stdout:64424509444 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 msgr2=0x7f6a18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 0x7f6a18069b20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000c10 tx=0x7f6a24001610 comp rx=0 tx=0).stop 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 msgr2=0x7f6a3c1dbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c098340 tx=0x7f6a20005840 comp rx=0 tx=0).stop 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 shutdown_connections 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a18067660 0x7f6a18069b20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a3c13e5f0 0x7f6a3c0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a3c13e190 0x7f6a3c1dbbb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 --2- 172.21.15.119:0/2621128602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a200037b0 0x7f6a3c072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:55.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 >> 172.21.15.119:0/2621128602 conn(0x7f6a3c09a230 msgr2=0x7f6a3c0b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:55.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 shutdown_connections 2024-03-08T21:33:55.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:55.911+0000 7f6a30c00640 1 -- 172.21.15.119:0/2621128602 wait complete. 2024-03-08T21:33:55.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2024-03-08T21:33:56.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-08T21:33:56.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-08T21:33:56.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-08T21:33:56.879 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-08T21:33:56.887 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-08T21:33:56.888 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-08T21:33:56.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-08T21:33:56.916 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-08T21:33:57.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 Processor -- start 2024-03-08T21:33:57.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 -- start start 2024-03-08T21:33:57.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95480b46b0 0x7f95481463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b6670 0x7f95480b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95480b3fa0 con 0x7f95480b4a90 2024-03-08T21:33:57.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954806dcc0 con 0x7f95480b46b0 2024-03-08T21:33:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954dc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480b7000 con 0x7f95480b6670 2024-03-08T21:33:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f9547400640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f95480b4a90 0x7f954813cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37070/0 (socket says 172.21.15.119:37070) 2024-03-08T21:33:57.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f9547400640 1 -- 172.21.15.119:0/73604272 learned_addr learned my addr 172.21.15.119:0/73604272 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f9547e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95480b46b0 0x7f95481463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.071+0000 7f954d200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b6670 0x7f95480b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.075+0000 7f9547e00640 1 -- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b6670 msgr2=0x7f95480b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.075+0000 7f9547e00640 1 --2- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b6670 0x7f95480b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.075+0000 7f9547e00640 1 -- 172.21.15.119:0/73604272 >> v1:172.21.15.160:6789/0 conn(0x7f95480b4a90 legacy=0x7f954813cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.075+0000 7f9547e00640 1 -- 172.21.15.119:0/73604272 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548146c20 con 0x7f95480b46b0 2024-03-08T21:33:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f9547e00640 1 --2- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b46b0 0x7f95481463c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95380071d0 tx=0x7f953801d3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0acc7751c05dcf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f9546a00640 1 -- 172.21.15.119:0/73604272 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380b1070 con 0x7f95480b46b0 2024-03-08T21:33:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f9546a00640 1 -- 172.21.15.119:0/73604272 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9538008be0 con 0x7f95480b46b0 2024-03-08T21:33:57.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f9546a00640 1 -- 172.21.15.119:0/73604272 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953800a0d0 con 0x7f95480b46b0 2024-03-08T21:33:57.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 -- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b46b0 msgr2=0x7f95481463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 --2- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b46b0 0x7f95481463c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95380071d0 tx=0x7f953801d3a0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 -- 172.21.15.119:0/73604272 shutdown_connections 2024-03-08T21:33:57.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 --2- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b6670 0x7f95480b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 --2- 172.21.15.119:0/73604272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b46b0 0x7f95481463c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 -- 172.21.15.119:0/73604272 >> 172.21.15.119:0/73604272 conn(0x7f954809a230 msgr2=0x7f954809a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 -- 172.21.15.119:0/73604272 shutdown_connections 2024-03-08T21:33:57.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.079+0000 7f954dc00640 1 -- 172.21.15.119:0/73604272 wait complete. 2024-03-08T21:33:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.083+0000 7f954dc00640 1 Processor -- start 2024-03-08T21:33:57.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.083+0000 7f954dc00640 1 -- start start 2024-03-08T21:33:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.083+0000 7f954dc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.083+0000 7f954dc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 0x7f9548142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95480b6670 0x7f95480b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37708/0 (socket says 172.21.15.119:37708) 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 -- 172.21.15.119:0/3713428288 learned_addr learned my addr 172.21.15.119:0/3713428288 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954814ff70 con 0x7f95480b6670 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548146900 con 0x7f95480b4a90 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95481500f0 con 0x7f95480b46b0 2024-03-08T21:33:57.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547400640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 0x7f9548142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 -- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 msgr2=0x7f9548142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 0x7f9548142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 -- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95480b6670 msgr2=0x7f95480b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95480b6670 0x7f95480b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480729f0 con 0x7f95480b46b0 2024-03-08T21:33:57.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547400640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 0x7f9548142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f9547e00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f953801afd0 tx=0x7f953801a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95380b1040 con 0x7f95480b46b0 2024-03-08T21:33:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953800a2d0 con 0x7f95480b46b0 2024-03-08T21:33:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95481df3b0 con 0x7f95480b46b0 2024-03-08T21:33:57.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953800a6c0 con 0x7f95480b46b0 2024-03-08T21:33:57.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.087+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95480724c0 con 0x7f95480b46b0 2024-03-08T21:33:57.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.091+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9548075080 con 0x7f95480b46b0 2024-03-08T21:33:57.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.091+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f95380be060 con 0x7f95480b46b0 2024-03-08T21:33:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.091+0000 7f953fe00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 0x7f9528069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.095+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f953811ecb0 con 0x7f95480b46b0 2024-03-08T21:33:57.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.095+0000 7f9547400640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 0x7f9528069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.095+0000 7f9547400640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 0x7f9528069b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95480b2af0 tx=0x7f9534009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.099+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f95380170e0 con 0x7f95480b46b0 2024-03-08T21:33:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.159+0000 7f4421000640 1 Processor -- start 2024-03-08T21:33:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.159+0000 7f4421000640 1 -- start start 2024-03-08T21:33:57.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f4421000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f441c06cb30 0x7f441c072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f4421000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f441c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f4421000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c06cf10 con 0x7f441c13cb90 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f4421000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c072750 con 0x7f441c06cb30 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f4421000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0b46f0 con 0x7f441c070b20 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441be00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f441c13cb90 0x7f441c0b3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50992/0 (socket says 172.21.15.119:50992) 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441be00640 1 -- 172.21.15.119:0/455861657 learned_addr learned my addr 172.21.15.119:0/455861657 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785792334 0 0) 0x7f441c06cf10 con 0x7f441c13cb90 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4400003530 con 0x7f441c13cb90 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400574914 0 0) 0x7f4400003530 con 0x7f441c13cb90 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 msgr2=0x7f441c1462a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.163+0000 7f441a000640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f441c1462a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 >> v2:172.21.15.160:3300/0 conn(0x7f441c06cb30 msgr2=0x7f441c072210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 --2- 172.21.15.119:0/455861657 >> v2:172.21.15.160:3300/0 conn(0x7f441c06cb30 0x7f441c072210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c070600 con 0x7f441c13cb90 2024-03-08T21:33:57.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f44140019e0 con 0x7f441c13cb90 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 >> v1:172.21.15.119:6789/0 conn(0x7f441c13cb90 legacy=0x7f441c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f4400003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4400004170 0x7f4400004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4400004e70 0x7f44000059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c072750 con 0x7f4400004e70 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0b46f0 con 0x7f4400004170 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400005ee0 con 0x7f441c070b20 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f4400003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441aa00640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4400004170 0x7f4400004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 -- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4400004170 msgr2=0x7f4400004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4400004170 0x7f4400004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 -- 172.21.15.119:0/455861657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4400004e70 msgr2=0x7f44000059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441be00640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4400004e70 0x7f44000059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4400004e70 0x7f44000059a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441b400640 1 -- 172.21.15.119:0/455861657 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44000061a0 con 0x7f441c070b20 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441aa00640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4400004170 0x7f4400004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f441be00640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4400004e70 0x7f44000059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f3cd8800640 1 Processor -- start 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.167+0000 7f3cd8800640 1 -- start start 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd8800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3cd00b2f20 0x7f3cd01465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd8800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00b3b20 con 0x7f3cd0146b10 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd8800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00b4b50 con 0x7f3cd013d410 2024-03-08T21:33:57.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd8800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd006d0f0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd5400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3cd00b2f20 0x7f3cd01465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd6800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3cd0146b10 0x7f3cd014d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:50994/0 (socket says 172.21.15.119:50994) 2024-03-08T21:33:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd6800640 1 -- 172.21.15.119:0/808352795 learned_addr learned my addr 172.21.15.119:0/808352795 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f98b7600640 1 Processor -- start 2024-03-08T21:33:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f98b7600640 1 -- start start 2024-03-08T21:33:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7fc31ba00640 1 Processor -- start 2024-03-08T21:33:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd5400640 1 -- 172.21.15.119:0/808352795 >> v1:172.21.15.160:6789/0 conn(0x7f3cd013d410 legacy=0x7f3cd006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd5400640 1 -- 172.21.15.119:0/808352795 >> v1:172.21.15.119:6789/0 conn(0x7f3cd0146b10 legacy=0x7f3cd014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd4a00640 1 -- 172.21.15.119:0/808352795 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509856558 0 0) 0x7f3cd00b4b50 con 0x7f3cd013d410 2024-03-08T21:33:57.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f441b400640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f4400003a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f440c0097e0 tx=0x7f440c01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beed2d7a8ed86af server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7fc31ba00640 1 -- start start 2024-03-08T21:33:57.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f3cd5400640 1 -- 172.21.15.119:0/808352795 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd006cd30 con 0x7f3cd00b2f20 2024-03-08T21:33:57.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f2848a00640 1 Processor -- start 2024-03-08T21:33:57.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f2848a00640 1 -- start start 2024-03-08T21:33:57.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.171+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0b0070 con 0x7f441c070b20 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b7600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 0x7f98a80368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b7600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98a80d4f10 0x7f98a80d7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b7600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a8035f30 con 0x7f98a8033cd0 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b7600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a80342e0 con 0x7f98a80d4f10 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b7600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a8035170 con 0x7f98a80338f0 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98afe00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f98a8033cd0 0x7f98a80cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37092/0 (socket says 172.21.15.119:37092) 2024-03-08T21:33:57.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98afe00640 1 -- 172.21.15.119:0/178271851 learned_addr learned my addr 172.21.15.119:0/178271851 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b5600640 1 --2- 172.21.15.119:0/178271851 >> v2:172.21.15.119:3300/0 conn(0x7f98a80d4f10 0x7f98a80d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c0ab600 con 0x7f441c070b20 2024-03-08T21:33:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f441a000640 1 -- 172.21.15.119:0/455861657 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0b0070 con 0x7f441c070b20 2024-03-08T21:33:57.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b4c00640 1 --2- 172.21.15.119:0/178271851 >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 0x7f98a80368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98af400640 1 -- 172.21.15.119:0/178271851 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810398750 0 0) 0x7f98a8035f30 con 0x7f98a8033cd0 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2848a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f2844140da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2848a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f284414abd0 0x7f28441412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2848a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284414b0d0 con 0x7f284414a7f0 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2848a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284414b3b0 con 0x7f284414abd0 2024-03-08T21:33:57.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2848a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284406fc70 con 0x7f28440b4e50 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b5600640 1 -- 172.21.15.119:0/178271851 >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 msgr2=0x7f98a80368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b5600640 1 --2- 172.21.15.119:0/178271851 >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 0x7f98a80368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b5600640 1 -- 172.21.15.119:0/178271851 >> v1:172.21.15.160:6789/0 conn(0x7f98a8033cd0 legacy=0x7f98a80cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b5600640 1 -- 172.21.15.119:0/178271851 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8035450 con 0x7f98a80d4f10 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f98b4c00640 1 --2- 172.21.15.119:0/178271851 >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 0x7f98a80368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2841e00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f284414a7f0 0x7f2844070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37104/0 (socket says 172.21.15.119:37104) 2024-03-08T21:33:57.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2841e00640 1 -- 172.21.15.119:0/2982990154 learned_addr learned my addr 172.21.15.119:0/2982990154 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f4421000640 1 -- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 msgr2=0x7f4400003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f4421000640 1 --2- 172.21.15.119:0/455861657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c070b20 0x7f4400003a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f440c0097e0 tx=0x7f440c01c300 comp rx=0 tx=0).stop 2024-03-08T21:33:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2842800640 1 --2- 172.21.15.119:0/2982990154 >> v2:172.21.15.160:3300/0 conn(0x7f284414abd0 0x7f28441412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2841400640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f2844140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884491043 0 0) 0x7f284414b0d0 con 0x7f284414a7f0 2024-03-08T21:33:57.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc31ba00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2828003530 con 0x7f284414a7f0 2024-03-08T21:33:57.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137318348 0 0) 0x7f2828003530 con 0x7f284414a7f0 2024-03-08T21:33:57.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 msgr2=0x7f2844140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f441be00640 1 -- 172.21.15.119:0/455861657 reap_dead start 2024-03-08T21:33:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc31ba00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc30c033d30 0x7fc30c035590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f2844140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc31ba00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c035f00 con 0x7fc30c0c8630 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc31ba00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c036e30 con 0x7fc30c033d30 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc319000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7fc31ba00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c029fe0 con 0x7fc30c033950 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 >> v2:172.21.15.160:3300/0 conn(0x7f284414abd0 msgr2=0x7f28441412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 --2- 172.21.15.119:0/2982990154 >> v2:172.21.15.160:3300/0 conn(0x7f284414abd0 0x7f28441412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440726e0 con 0x7f284414a7f0 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f2834001680 con 0x7f284414a7f0 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 >> v1:172.21.15.160:6789/0 conn(0x7f284414a7f0 legacy=0x7f2844070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28280039c0 0x7f2828003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37742/0 (socket says 172.21.15.119:37742) 2024-03-08T21:33:57.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 -- 172.21.15.119:0/1337609496 learned_addr learned my addr 172.21.15.119:0/1337609496 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2828004810 0x7f2828004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f28280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284414b3b0 con 0x7f2828004810 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284406fc70 con 0x7f28280039c0 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282800b9d0 con 0x7f28440b4e50 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.175+0000 7f2841e00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28280039c0 0x7f2828003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2842800640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f28280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2841e00640 1 -- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 msgr2=0x7f28280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2841e00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28440b4e50 0x7f28280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2841e00640 1 -- 172.21.15.119:0/2982990154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2828004810 msgr2=0x7f2828004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2841e00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2828004810 0x7f2828004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f2841e00640 1 -- 172.21.15.119:0/2982990154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440726e0 con 0x7f28280039c0 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 -- 172.21.15.119:0/455861657 shutdown_connections 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 -- 172.21.15.119:0/455861657 >> 172.21.15.119:0/455861657 conn(0x7f441c0b8680 msgr2=0x7f441c0b8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 -- 172.21.15.119:0/455861657 shutdown_connections 2024-03-08T21:33:57.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 -- 172.21.15.119:0/455861657 wait complete. 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 -- 172.21.15.119:0/1337609496 >> v2:172.21.15.119:3300/0 conn(0x7fc30c033d30 msgr2=0x7fc30c035590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 --2- 172.21.15.119:0/1337609496 >> v2:172.21.15.119:3300/0 conn(0x7fc30c033d30 0x7fc30c035590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 -- 172.21.15.119:0/1337609496 >> v1:172.21.15.119:6789/0 conn(0x7fc30c0c8630 legacy=0x7fc30c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7fc319000640 1 -- 172.21.15.119:0/1337609496 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0361e0 con 0x7fc30c033950 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f1a2a400640 1 Processor -- start 2024-03-08T21:33:57.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f3cd5400640 1 --2- 172.21.15.119:0/808352795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd00b2f20 0x7f3cd01465d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097c0 tx=0x7f3cc401c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8e481f1a0ccdd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f1a2a400640 1 -- start start 2024-03-08T21:33:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f98b5600640 1 --2- 172.21.15.119:0/178271851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a80d7300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f98b0069ba0 tx=0x7f98b0097230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3a96a3fa06270c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f3cd4a00640 1 -- 172.21.15.119:0/808352795 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b0070 con 0x7f3cd00b2f20 2024-03-08T21:33:57.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f3cd4a00640 1 -- 172.21.15.119:0/808352795 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40ab600 con 0x7f3cd00b2f20 2024-03-08T21:33:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f3cd4a00640 1 -- 172.21.15.119:0/808352795 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40ab9d0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f98af400640 1 -- 172.21.15.119:0/178271851 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0126640 con 0x7f98a80d4f10 2024-03-08T21:33:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 Processor -- start 2024-03-08T21:33:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f98af400640 1 -- 172.21.15.119:0/178271851 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b01267e0 con 0x7f98a80d4f10 2024-03-08T21:33:57.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f98af400640 1 -- 172.21.15.119:0/178271851 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0126c10 con 0x7f98a80d4f10 2024-03-08T21:33:57.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 -- 172.21.15.119:0/808352795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd00b2f20 msgr2=0x7f3cd01465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 --2- 172.21.15.119:0/808352795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd00b2f20 0x7f3cd01465d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097c0 tx=0x7f3cc401c2a0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a2a400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 0x7f1a2414b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a2a400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1a2414b6c0 0x7f1a24155a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a2a400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a240714b0 con 0x7f1a2406afb0 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a2a400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a24070730 con 0x7f1a2414b6c0 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a2a400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24071720 con 0x7f1a240702d0 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1a2406afb0 0x7f1a24148300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51020/0 (socket says 172.21.15.119:51020) 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29000640 1 -- 172.21.15.119:0/3486485977 learned_addr learned my addr 172.21.15.119:0/3486485977 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:57.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2841e00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28280039c0 0x7f2828003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2834012a50 tx=0x7f2834027b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c123a4af11967e30 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a23e00640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 0x7f1a2414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29a00640 1 --2- 172.21.15.119:0/3486485977 >> v2:172.21.15.160:3300/0 conn(0x7f1a2414b6c0 0x7f1a24155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834007dd0 con 0x7f28280039c0 2024-03-08T21:33:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2834005ae0 con 0x7f28280039c0 2024-03-08T21:33:57.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2840a00640 1 -- 172.21.15.119:0/2982990154 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340120d0 con 0x7f28280039c0 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.179+0000 7f4421000640 1 -- start start 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a23400640 1 -- 172.21.15.119:0/3486485977 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221087465 0 0) 0x7f1a240714b0 con 0x7f1a2406afb0 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a23400640 1 -- 172.21.15.119:0/3486485977 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a08003530 con 0x7f1a2406afb0 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29a00640 1 -- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 msgr2=0x7f1a2414b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29a00640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 0x7f1a2414b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29a00640 1 -- 172.21.15.119:0/3486485977 >> v1:172.21.15.119:6789/0 conn(0x7f1a2406afb0 legacy=0x7f1a24148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 -- 172.21.15.119:0/178271851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 msgr2=0x7f98a80d7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 --2- 172.21.15.119:0/178271851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a80d7300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f98b0069ba0 tx=0x7f98b0097230 comp rx=0 tx=0).stop 2024-03-08T21:33:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a29a00640 1 -- 172.21.15.119:0/3486485977 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2406b390 con 0x7f1a2414b6c0 2024-03-08T21:33:57.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f1a23e00640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 0x7f1a2414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 -- 172.21.15.119:0/178271851 shutdown_connections 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 --2- 172.21.15.119:0/178271851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a80d7300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 --2- 172.21.15.119:0/178271851 >> v2:172.21.15.160:3300/0 conn(0x7f98a80338f0 0x7f98a80368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 -- 172.21.15.119:0/178271851 >> 172.21.15.119:0/178271851 conn(0x7f98a803a860 msgr2=0x7f98a803ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 -- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28280039c0 msgr2=0x7f2828003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 --2- 172.21.15.119:0/2982990154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28280039c0 0x7f2828003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2834012a50 tx=0x7f2834027b50 comp rx=0 tx=0).stop 2024-03-08T21:33:57.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2842800640 1 -- 172.21.15.119:0/2982990154 reap_dead start 2024-03-08T21:33:57.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 -- 172.21.15.119:0/808352795 shutdown_connections 2024-03-08T21:33:57.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 --2- 172.21.15.119:0/808352795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd00b2f20 0x7f3cd01465d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 -- 172.21.15.119:0/808352795 >> 172.21.15.119:0/808352795 conn(0x7f3cd00b8520 msgr2=0x7f3cd00b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 -- 172.21.15.119:0/178271851 shutdown_connections 2024-03-08T21:33:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 -- 172.21.15.119:0/2982990154 shutdown_connections 2024-03-08T21:33:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 -- 172.21.15.119:0/2982990154 >> 172.21.15.119:0/2982990154 conn(0x7f28440b5320 msgr2=0x7f28440b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f441c1d88c0 0x7f441c1d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 -- 172.21.15.119:0/808352795 shutdown_connections 2024-03-08T21:33:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f98b7600640 1 -- 172.21.15.119:0/178271851 wait complete. 2024-03-08T21:33:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f441b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 -- 172.21.15.119:0/2982990154 shutdown_connections 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c0aeab0 0x7f441c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c067db0 con 0x7f441c070b20 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0b4380 con 0x7f441c1d88c0 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f4421000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c067f30 con 0x7f441c0aeab0 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f3cd8800640 1 -- 172.21.15.119:0/808352795 wait complete. 2024-03-08T21:33:57.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7fc319000640 1 --2- 172.21.15.119:0/1337609496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc30800aa10 tx=0x7fc30801ea20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8cd8cbcfa732691 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f441b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43918/0 (socket says 172.21.15.119:43918) 2024-03-08T21:33:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f441b400640 1 -- 172.21.15.119:0/1508899505 learned_addr learned my addr 172.21.15.119:0/1508899505 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f441aa00640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f441c1d88c0 0x7f441c1d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f441be00640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c0aeab0 0x7f441c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc313400640 1 -- 172.21.15.119:0/1337609496 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080b4070 con 0x7fc30c033950 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc313400640 1 -- 172.21.15.119:0/1337609496 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080a78b0 con 0x7fc30c033950 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc313400640 1 -- 172.21.15.119:0/1337609496 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800b040 con 0x7fc30c033950 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 -- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c0aeab0 msgr2=0x7f441c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c0aeab0 0x7f441c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 -- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f441c1d88c0 msgr2=0x7f441c1d8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f441c1d88c0 0x7f441c1d8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 -- 172.21.15.119:0/1508899505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0af470 con 0x7f441c070b20 2024-03-08T21:33:57.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f98b7600640 1 Processor -- start 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 -- 172.21.15.119:0/1337609496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 msgr2=0x7fc30c036570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1337609496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc30800aa10 tx=0x7fc30801ea20 comp rx=0 tx=0).stop 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 -- 172.21.15.119:0/1337609496 shutdown_connections 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1337609496 >> v2:172.21.15.119:3300/0 conn(0x7fc30c033d30 0x7fc30c035590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1337609496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c033950 0x7fc30c036570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 -- 172.21.15.119:0/1337609496 >> 172.21.15.119:0/1337609496 conn(0x7fc30c03a890 msgr2=0x7fc30c03aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f441b400640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f440c01c130 tx=0x7f4400005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 Processor -- start 2024-03-08T21:33:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 -- 172.21.15.119:0/1337609496 shutdown_connections 2024-03-08T21:33:57.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 -- start start 2024-03-08T21:33:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f98b7600640 1 -- start start 2024-03-08T21:33:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0b0040 con 0x7f441c070b20 2024-03-08T21:33:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c0b7670 con 0x7f441c070b20 2024-03-08T21:33:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0093b0 con 0x7f441c070b20 2024-03-08T21:33:57.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0b1380 con 0x7f441c070b20 2024-03-08T21:33:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c1d83a0 con 0x7f441c070b20 2024-03-08T21:33:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7fc31ba00640 1 -- 172.21.15.119:0/1337609496 wait complete. 2024-03-08T21:33:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 0x7f3cd009c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd013d410 0x7f3cd01e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 0x7f3cd0071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b9040 con 0x7f3cd00b2f20 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd013d7f0 con 0x7f3cd013d410 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd8800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b91c0 con 0x7f3cd0146b10 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f98b7600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 0x7f98a80cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.183+0000 7f2848a00640 1 -- 172.21.15.119:0/2982990154 wait complete. 2024-03-08T21:33:57.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f2848a00640 1 Processor -- start 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd6800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 0x7f3cd0071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd6800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 0x7f3cd0071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37782/0 (socket says 172.21.15.119:37782) 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.187+0000 7f3cd6800640 1 -- 172.21.15.119:0/2819179482 learned_addr learned my addr 172.21.15.119:0/2819179482 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 0x7f3cd009c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 0x7f98a8169120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a816c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8037ac0 con 0x7f98a80d4f10 2024-03-08T21:33:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a80d02c0 con 0x7f98a8033cd0 2024-03-08T21:33:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8037c40 con 0x7f98a80338f0 2024-03-08T21:33:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 Processor -- start 2024-03-08T21:33:57.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0750f0 con 0x7f441c070b20 2024-03-08T21:33:57.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b4c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 0x7f98a80cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b4c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 0x7f98a80cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37788/0 (socket says 172.21.15.119:37788) 2024-03-08T21:33:57.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 -- start start 2024-03-08T21:33:57.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b4c00640 1 -- 172.21.15.119:0/3802589507 learned_addr learned my addr 172.21.15.119:0/3802589507 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 0x7f98a8169120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 -- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 msgr2=0x7f3cd0071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 0x7f3cd0071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 -- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd013d410 msgr2=0x7f3cd01e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 -- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 msgr2=0x7f98a80cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 0x7f98a80cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 -- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 msgr2=0x7f98a816c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a816c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd013d410 0x7f3cd01e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 -- 172.21.15.119:0/2819179482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd01418a0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 -- 172.21.15.119:0/3802589507 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a80ca650 con 0x7f98a8033cd0 2024-03-08T21:33:57.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f440c0b3040 con 0x7f441c070b20 2024-03-08T21:33:57.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f3cd5e00640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 0x7f3cd009c530 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c750 tx=0x7f3ccc00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98afe00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 0x7f98a8169120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a8008c00 tx=0x7f98a400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc30c033950 0x7fc30c0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 0x7fc30c0c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 0x7fc30c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0da300 con 0x7fc30c033950 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c035ce0 con 0x7fc30c033d30 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc31ba00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0da480 con 0x7fc30c0c8630 2024-03-08T21:33:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f2848a00640 1 -- start start 2024-03-08T21:33:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40074e0 con 0x7f98a8033cd0 2024-03-08T21:33:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4007680 con 0x7f98a8033cd0 2024-03-08T21:33:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4004a30 con 0x7f98a8033cd0 2024-03-08T21:33:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc319a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 0x7fc30c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a80c7550 con 0x7f98a8033cd0 2024-03-08T21:33:57.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a80cc480 con 0x7f98a8033cd0 2024-03-08T21:33:57.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc319a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 0x7fc30c0b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37800/0 (socket says 172.21.15.119:37800) 2024-03-08T21:33:57.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc319a00640 1 -- 172.21.15.119:0/1422888473 learned_addr learned my addr 172.21.15.119:0/1422888473 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f4413400640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 0x7f43fc069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 0x7fc30c0c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f440c120840 con 0x7f441c070b20 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 -- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 msgr2=0x7fc30c0b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 0x7fc30c0b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 -- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc30c033950 msgr2=0x7fc30c0b6ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc30c033950 0x7fc30c0b6ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 -- 172.21.15.119:0/1422888473 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0c4f90 con 0x7fc30c033d30 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7fc313e00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 0x7fc30c0c3640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc314073bf0 tx=0x7fc3140714b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140733c0 con 0x7fc30c033d30 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314071b90 con 0x7fc30c033d30 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314093480 con 0x7fc30c033d30 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0c5270 con 0x7fc30c033d30 2024-03-08T21:33:57.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0c2fa0 con 0x7fc30c033d30 2024-03-08T21:33:57.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a80053a0 con 0x7f98a8033cd0 2024-03-08T21:33:57.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c0053d0 con 0x7fc30c033d30 2024-03-08T21:33:57.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 0x7f284413a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f98a4011070 con 0x7f98a8033cd0 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 0x7f28441466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 0x7f284413a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35660/0 (socket says 172.21.15.119:35660) 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 0x7f284413a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43932/0 (socket says 172.21.15.119:43932) 2024-03-08T21:33:57.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc314093620 con 0x7fc30c033d30 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 -- 172.21.15.119:0/4094330349 learned_addr learned my addr 172.21.15.119:0/4094330349 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844070a20 con 0x7f28280039c0 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f1a29a00640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2414b6c0 0x7f1a24155a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009dc0 tx=0x7f1a1c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b111515b8ba619c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f1a23400640 1 -- 172.21.15.119:0/3486485977 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b2070 con 0x7f1a2414b6c0 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f1a23400640 1 -- 172.21.15.119:0/3486485977 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a5810 con 0x7f1a2414b6c0 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.191+0000 7f1a23400640 1 -- 172.21.15.119:0/3486485977 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0a5be0 con 0x7f1a2414b6c0 2024-03-08T21:33:57.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f1a2a400640 1 -- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2414b6c0 msgr2=0x7f1a24155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f1a2a400640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2414b6c0 0x7f1a24155a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009dc0 tx=0x7f1a1c01c950 comp rx=0 tx=0).stop 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440708a0 con 0x7f28440b2d70 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2844141920 con 0x7f28441dbe70 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2842800640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 0x7f28441466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f98acc00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 0x7f9890069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98a4085330 con 0x7f98a8033cd0 2024-03-08T21:33:57.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 0x7fc2f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3140ffd40 con 0x7fc30c033d30 2024-03-08T21:33:57.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 -- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 msgr2=0x7f28441466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 0x7f28441466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f441aa00640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 0x7f43fc069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 -- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 msgr2=0x7f284413a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 0x7f284413a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2841400640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844142910 con 0x7f28440b2d70 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.195+0000 7f2842800640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 0x7f28441466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f2841400640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f283000e7f0 tx=0x7f283000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7fc319000640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 0x7fc2f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f98b4c00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 0x7f9890069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 -- 172.21.15.119:0/3486485977 shutdown_connections 2024-03-08T21:33:57.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2414b6c0 0x7f1a24155a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 --2- 172.21.15.119:0/3486485977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a240702d0 0x7f1a2414b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 -- 172.21.15.119:0/3486485977 >> 172.21.15.119:0/3486485977 conn(0x7f1a240b8710 msgr2=0x7f1a240b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f98b4c00640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 0x7f9890069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f989c009970 tx=0x7f989c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 -- 172.21.15.119:0/3486485977 shutdown_connections 2024-03-08T21:33:57.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f441aa00640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 0x7f43fc069ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f441c13fde0 tx=0x7f4408006ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f1a2a400640 1 -- 172.21.15.119:0/3486485977 wait complete. 2024-03-08T21:33:57.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7fc319000640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 0x7fc2f4069b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3080b1000 tx=0x7fc3080a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.199+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f98a4056020 con 0x7f98a8033cd0 2024-03-08T21:33:57.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f1a2a400640 1 Processor -- start 2024-03-08T21:33:57.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f440c0bb020 con 0x7f441c070b20 2024-03-08T21:33:57.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f1a2a400640 1 -- start start 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc003b80 con 0x7f3cd00b2f20 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc003d20 con 0x7f3cd00b2f20 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0052b0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00722d0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd01462e0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f1a2a400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 0x7f1a2413de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830017070 con 0x7f28440b2d70 2024-03-08T21:33:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f1a2a400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0067db0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f1a2a400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 0x7f1a240b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283000c940 con 0x7f28440b2d70 2024-03-08T21:33:57.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.203+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fc3140d0b70 con 0x7fc30c033d30 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35676/0 (socket says 172.21.15.119:35676) 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 -- 172.21.15.119:0/2007269359 learned_addr learned my addr 172.21.15.119:0/2007269359 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a29000640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 0x7f1a2413de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a29a00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 0x7f1a240b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24148a10 con 0x7f1a2406afb0 2024-03-08T21:33:57.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283000cd30 con 0x7f28440b2d70 2024-03-08T21:33:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2414bb20 con 0x7f1a240702d0 2024-03-08T21:33:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24148b90 con 0x7f1a2414b6c0 2024-03-08T21:33:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844147ac0 con 0x7f28440b2d70 2024-03-08T21:33:57.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2844142630 con 0x7f28440b2d70 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 -- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 msgr2=0x7f1a240b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 0x7f1a240b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 -- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 msgr2=0x7f1a2413de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 0x7f1a2413de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a23e00640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2413cd80 con 0x7f1a240702d0 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a29000640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 0x7f1a2413de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.207+0000 7f1a29a00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 0x7f1a240b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:57.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28441dc250 con 0x7f28440b2d70 2024-03-08T21:33:57.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3ccc005450 con 0x7f3cd00b2f20 2024-03-08T21:33:57.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f3cca000640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 0x7f3cb4069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ccc086190 con 0x7f3cd00b2f20 2024-03-08T21:33:57.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f283001a070 con 0x7f28440b2d70 2024-03-08T21:33:57.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f283a000640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 0x7f2824069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a23e00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000ebe0 tx=0x7f1a1000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10017070 con 0x7f1a240702d0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000cc30 con 0x7f1a240702d0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10013470 con 0x7f1a240702d0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2413f200 con 0x7f1a240702d0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.211+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2413d020 con 0x7f1a240702d0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f2841e00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 0x7f2824069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f3cd5400640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 0x7f3cb4069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24075080 con 0x7f1a240702d0 2024-03-08T21:33:57.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28300540f0 con 0x7f28440b2d70 2024-03-08T21:33:57.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1a1001a070 con 0x7f1a240702d0 2024-03-08T21:33:57.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f2841e00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 0x7f2824069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28340b5000 tx=0x7f2834001980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f3cd5400640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 0x7f3cb4069bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40ad000 tx=0x7f3cc4004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f3ccc056e80 con 0x7f3cd00b2f20 2024-03-08T21:33:57.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.215+0000 7f1a20c00640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 0x7f1a04069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.219+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a10053eb0 con 0x7f1a240702d0 2024-03-08T21:33:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.219+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f28441dc250 con 0x7f28440b2d70 2024-03-08T21:33:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.219+0000 7f1a29000640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 0x7f1a04069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.219+0000 7f1a29000640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 0x7f1a04069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a14007fd0 tx=0x7f1a14007d00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.223+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1a10055e10 con 0x7f1a240702d0 2024-03-08T21:33:57.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 Processor -- start 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 -- start start 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23d00b7230 0x7f23d00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f23d0097790 0x7f23d0146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d00b49d0 con 0x7f23d0097c20 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d00b7de0 con 0x7f23d0097790 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cfe00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d00b8000 con 0x7f23d00b7230 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cea00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23d00b7230 0x7f23d00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cea00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f23d00b7230 0x7f23d00b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:35682/0 (socket says 172.21.15.119:35682) 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cea00640 1 -- 172.21.15.119:0/1245866147 learned_addr learned my addr 172.21.15.119:0/1245866147 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cf400640 1 --1- 172.21.15.119:0/1245866147 >> v1:172.21.15.160:6789/0 conn(0x7f23d0097c20 0x7f23d014a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:37108/0 (socket says 172.21.15.119:37108) 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cea00640 1 -- 172.21.15.119:0/1245866147 >> v2:172.21.15.119:3300/0 conn(0x7f23d0097790 msgr2=0x7f23d0146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.239+0000 7f23cea00640 1 --2- 172.21.15.119:0/1245866147 >> v2:172.21.15.119:3300/0 conn(0x7f23d0097790 0x7f23d0146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.243+0000 7f23cea00640 1 -- 172.21.15.119:0/1245866147 >> v1:172.21.15.160:6789/0 conn(0x7f23d0097c20 legacy=0x7f23d014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.243+0000 7f23cea00640 1 -- 172.21.15.119:0/1245866147 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d00b7610 con 0x7f23d00b7230 2024-03-08T21:33:57.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cea00640 1 --2- 172.21.15.119:0/1245866147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d00b78a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23d009aeb0 tx=0x7f23bc01c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b9c1085f79e164 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cd600640 1 -- 172.21.15.119:0/1245866147 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0b0070 con 0x7f23d00b7230 2024-03-08T21:33:57.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cd600640 1 -- 172.21.15.119:0/1245866147 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc0ab600 con 0x7f23d00b7230 2024-03-08T21:33:57.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cd600640 1 -- 172.21.15.119:0/1245866147 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0ab9d0 con 0x7f23d00b7230 2024-03-08T21:33:57.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 -- 172.21.15.119:0/1245866147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 msgr2=0x7f23d00b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 --2- 172.21.15.119:0/1245866147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d00b78a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23d009aeb0 tx=0x7f23bc01c290 comp rx=0 tx=0).stop 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 -- 172.21.15.119:0/1245866147 shutdown_connections 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 --2- 172.21.15.119:0/1245866147 >> v2:172.21.15.119:3300/0 conn(0x7f23d0097790 0x7f23d0146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 --2- 172.21.15.119:0/1245866147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d00b78a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 -- 172.21.15.119:0/1245866147 >> 172.21.15.119:0/1245866147 conn(0x7f23d009a230 msgr2=0x7f23d009a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 -- 172.21.15.119:0/1245866147 shutdown_connections 2024-03-08T21:33:57.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.247+0000 7f23cfe00640 1 -- 172.21.15.119:0/1245866147 wait complete. 2024-03-08T21:33:57.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.251+0000 7f23cfe00640 1 Processor -- start 2024-03-08T21:33:57.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.251+0000 7f23cfe00640 1 -- start start 2024-03-08T21:33:57.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 0x7f23d01f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d01ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 0x7f23d01f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 0x7f23d01f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43960/0 (socket says 172.21.15.119:43960) 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:37836/0 (socket says 172.21.15.119:37836) 2024-03-08T21:33:57.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cea00640 1 -- 172.21.15.119:0/271833584 learned_addr learned my addr 172.21.15.119:0/271833584 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d009b0a0 con 0x7f23d0097790 2024-03-08T21:33:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d009af20 con 0x7f23d00b7230 2024-03-08T21:33:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cf400640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d01ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d0154790 con 0x7f23d0097c20 2024-03-08T21:33:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 -- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 msgr2=0x7f23d01ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d01ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 -- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 msgr2=0x7f23d01f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 0x7f23d01f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.255+0000 7f23ce000640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0072a70 con 0x7f23d0097c20 2024-03-08T21:33:57.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23ce000640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23c000b420 tx=0x7f23c000b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011830 con 0x7f23d0097c20 2024-03-08T21:33:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d01f0a90 con 0x7f23d0097c20 2024-03-08T21:33:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d0072780 con 0x7f23d0097c20 2024-03-08T21:33:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0016070 con 0x7f23d0097c20 2024-03-08T21:33:57.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.259+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0011830 con 0x7f23d0097c20 2024-03-08T21:33:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.263+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a80052a0 con 0x7f23d0097c20 2024-03-08T21:33:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.263+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f23c00119d0 con 0x7f23d0097c20 2024-03-08T21:33:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.263+0000 7f23c6a00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 0x7f23b0069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.263+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23c0084fc0 con 0x7f23d0097c20 2024-03-08T21:33:57.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.263+0000 7f23cea00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 0x7f23b0069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.267+0000 7f23cea00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 0x7f23b0069d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23bc01c2d0 tx=0x7f23bc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.267+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f23c00555e0 con 0x7f23d0097c20 2024-03-08T21:33:57.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.438+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95481df580 con 0x7f95480b46b0 2024-03-08T21:33:57.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.438+0000 7f953fe00640 1 -- 172.21.15.119:0/3713428288 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95380ef920 con 0x7f95480b46b0 2024-03-08T21:33:57.425 INFO:teuthology.orchestra.run.smithi119.stdout:64424509448 2024-03-08T21:33:57.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 msgr2=0x7f9528069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 0x7f9528069b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95480b2af0 tx=0x7f9534009040 comp rx=0 tx=0).stop 2024-03-08T21:33:57.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 msgr2=0x7f95481deab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f953801afd0 tx=0x7f953801a140 comp rx=0 tx=0).stop 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 shutdown_connections 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9528067660 0x7f9528069b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95480b6670 0x7f95480b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95480b4a90 0x7f9548142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 --2- 172.21.15.119:0/3713428288 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95480b46b0 0x7f95481deab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.442+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 >> 172.21.15.119:0/3713428288 conn(0x7f954809a230 msgr2=0x7f954806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.446+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 shutdown_connections 2024-03-08T21:33:57.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.446+0000 7f954dc00640 1 -- 172.21.15.119:0/3713428288 wait complete. 2024-03-08T21:33:57.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.2 2024-03-08T21:33:57.461 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.506+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98a803b160 con 0x7f98a8033cd0 2024-03-08T21:33:57.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.506+0000 7f98acc00640 1 -- 172.21.15.119:0/3802589507 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98a4055920 con 0x7f98a8033cd0 2024-03-08T21:33:57.494 INFO:teuthology.orchestra.run.smithi119.stdout:64424509447 2024-03-08T21:33:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 msgr2=0x7f9890069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 0x7f9890069bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f989c009970 tx=0x7f989c008040 comp rx=0 tx=0).stop 2024-03-08T21:33:57.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 msgr2=0x7f98a8169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 0x7f98a8169120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f98a8008c00 tx=0x7f98a400c8e0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 shutdown_connections 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9890067730 0x7f9890069bf0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f989c009970 tx=0x7f989c008040 comp rx=0 tx=0).stop 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98a80d4f10 0x7f98a816c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98a8033cd0 0x7f98a8169120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 --2- 172.21.15.119:0/3802589507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f98a80338f0 0x7f98a80cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.510+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 >> 172.21.15.119:0/3802589507 conn(0x7f98a803a860 msgr2=0x7f98a8006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.514+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 shutdown_connections 2024-03-08T21:33:57.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.514+0000 7f98b7600640 1 -- 172.21.15.119:0/3802589507 wait complete. 2024-03-08T21:33:57.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2024-03-08T21:33:57.521 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.546+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc30c0c3b80 con 0x7fc30c033d30 2024-03-08T21:33:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.546+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f441c0af730 con 0x7f441c070b20 2024-03-08T21:33:57.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.546+0000 7f4413400640 1 -- 172.21.15.119:0/1508899505 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f440c016010 con 0x7f441c070b20 2024-03-08T21:33:57.534 INFO:teuthology.orchestra.run.smithi119.stdout:64424509448 2024-03-08T21:33:57.534 INFO:teuthology.orchestra.run.smithi119.stdout:60129542150 2024-03-08T21:33:57.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.546+0000 7fc310c00640 1 -- 172.21.15.119:0/1422888473 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3140d0470 con 0x7fc30c033d30 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 msgr2=0x7f43fc069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 0x7f43fc069ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f441c13fde0 tx=0x7f4408006ef0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 msgr2=0x7f441c0aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f440c01c130 tx=0x7f4400005840 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 shutdown_connections 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f43fc0676e0 0x7f43fc069ba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f441c0aeab0 0x7f441c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f441c1d88c0 0x7f441c1d8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 --2- 172.21.15.119:0/1508899505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f441c070b20 0x7f441c0aff60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 >> 172.21.15.119:0/1508899505 conn(0x7f441c0b8680 msgr2=0x7f441c13c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 msgr2=0x7fc2f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 0x7fc2f4069b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc3080b1000 tx=0x7fc3080a9070 comp rx=0 tx=0).stop 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 msgr2=0x7fc30c0c3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 0x7fc30c0c3640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc314073bf0 tx=0x7fc3140714b0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 shutdown_connections 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc2f4067660 0x7fc2f4069b20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc30c0c8630 0x7fc30c0b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc30c033d30 0x7fc30c0c3640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 --2- 172.21.15.119:0/1422888473 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc30c033950 0x7fc30c0b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 >> 172.21.15.119:0/1422888473 conn(0x7fc30c03a890 msgr2=0x7fc30c006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 shutdown_connections 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 shutdown_connections 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7f4421000640 1 -- 172.21.15.119:0/1508899505 wait complete. 2024-03-08T21:33:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.550+0000 7fc31ba00640 1 -- 172.21.15.119:0/1422888473 wait complete. 2024-03-08T21:33:57.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f28440684c0 con 0x7f28440b2d70 2024-03-08T21:33:57.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.554+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3cd00b34e0 con 0x7f3cd00b2f20 2024-03-08T21:33:57.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cca000640 1 -- 172.21.15.119:0/2819179482 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ccc056780 con 0x7f3cd00b2f20 2024-03-08T21:33:57.543 INFO:teuthology.orchestra.run.smithi119.stdout:64424509449 2024-03-08T21:33:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f283a000640 1 -- 172.21.15.119:0/4094330349 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2830056050 con 0x7f28440b2d70 2024-03-08T21:33:57.544 INFO:teuthology.orchestra.run.smithi119.stdout:64424509447 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 msgr2=0x7f3cb4069bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 0x7f3cb4069bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40ad000 tx=0x7f3cc4004740 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 msgr2=0x7f3cd009c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 0x7f3cd009c530 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c750 tx=0x7f3ccc00cb50 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 shutdown_connections 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3cb4067730 0x7f3cb4069bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cd0146b10 0x7f3cd0071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cd013d410 0x7f3cd01e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 --2- 172.21.15.119:0/2819179482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd00b2f20 0x7f3cd009c530 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 >> 172.21.15.119:0/2819179482 conn(0x7f3cd00b8520 msgr2=0x7f3cd00b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 shutdown_connections 2024-03-08T21:33:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.558+0000 7f3cd8800640 1 -- 172.21.15.119:0/2819179482 wait complete. 2024-03-08T21:33:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 msgr2=0x7f2824069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 0x7f2824069b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28340b5000 tx=0x7f2834001980 comp rx=0 tx=0).stop 2024-03-08T21:33:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 msgr2=0x7f28441db930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f283000e7f0 tx=0x7f283000ecb0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 shutdown_connections 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28240676b0 0x7f2824069b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28441dbe70 0x7f28441466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28440b2d70 0x7f28441db930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 --2- 172.21.15.119:0/4094330349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28280039c0 0x7f284413a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 >> 172.21.15.119:0/4094330349 conn(0x7f28440b5320 msgr2=0x7f28440b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 shutdown_connections 2024-03-08T21:33:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.562+0000 7f2848a00640 1 -- 172.21.15.119:0/4094330349 wait complete. 2024-03-08T21:33:57.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.578+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a240b67f0 con 0x7f1a240702d0 2024-03-08T21:33:57.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.578+0000 7f1a20c00640 1 -- 172.21.15.119:0/2007269359 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a10059eb0 con 0x7f1a240702d0 2024-03-08T21:33:57.564 INFO:teuthology.orchestra.run.smithi119.stdout:60129542151 2024-03-08T21:33:57.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.5 2024-03-08T21:33:57.566 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 msgr2=0x7f1a04069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 0x7f1a04069b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a14007fd0 tx=0x7f1a14007d00 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 msgr2=0x7f1a24139ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000ebe0 tx=0x7f1a1000c520 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 shutdown_connections 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a040676b0 0x7f1a04069b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a2414b6c0 0x7f1a240b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a240702d0 0x7f1a24139ea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 --2- 172.21.15.119:0/2007269359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a2406afb0 0x7f1a2413de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 >> 172.21.15.119:0/2007269359 conn(0x7f1a240b8710 msgr2=0x7f1a240b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 shutdown_connections 2024-03-08T21:33:57.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.582+0000 7f1a2a400640 1 -- 172.21.15.119:0/2007269359 wait complete. 2024-03-08T21:33:57.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-03-08T21:33:57.571 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.6 2024-03-08T21:33:57.573 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2024-03-08T21:33:57.585 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f23a8005590 con 0x7f23d0097c20 2024-03-08T21:33:57.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23c6a00640 1 -- 172.21.15.119:0/271833584 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23c0059680 con 0x7f23d0097c20 2024-03-08T21:33:57.588 INFO:teuthology.orchestra.run.smithi119.stdout:64424509446 2024-03-08T21:33:57.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-03-08T21:33:57.589 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 msgr2=0x7f23b0069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 0x7f23b0069d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23bc01c2d0 tx=0x7f23bc0a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 msgr2=0x7f23d0072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23c000b420 tx=0x7f23c000b8e0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 shutdown_connections 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f23b0067860 0x7f23b0069d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23d00b7230 0x7f23d01ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23d0097c20 0x7f23d0072240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 --2- 172.21.15.119:0/271833584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23d0097790 0x7f23d01f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 >> 172.21.15.119:0/271833584 conn(0x7f23d009a230 msgr2=0x7f23d00b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 shutdown_connections 2024-03-08T21:33:57.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.602+0000 7f23cfe00640 1 -- 172.21.15.119:0/271833584 wait complete. 2024-03-08T21:33:57.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.7 2024-03-08T21:33:57.609 DEBUG:teuthology.parallel:result is None 2024-03-08T21:33:57.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T21:33:57.609 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:33:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 Processor -- start 2024-03-08T21:33:57.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 -- start start 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33980b4410 0x7f33980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 0x7f33980b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f339813eba0 0x7f339813f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339813f590 con 0x7f33980b4410 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980b5970 con 0x7f339813eba0 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f339e600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980b2be0 con 0x7f33980b47f0 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33980b4410 0x7f33980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33980b4410 0x7f33980b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43974/0 (socket says 172.21.15.119:43974) 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 -- 172.21.15.119:0/1027822283 learned_addr learned my addr 172.21.15.119:0/1027822283 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f338ea00640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 0x7f33980b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397e00640 1 --2- 172.21.15.119:0/1027822283 >> v2:172.21.15.160:3300/0 conn(0x7f339813eba0 0x7f339813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 -- 172.21.15.119:0/1027822283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 msgr2=0x7f33980b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 0x7f33980b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 -- 172.21.15.119:0/1027822283 >> v2:172.21.15.160:3300/0 conn(0x7f339813eba0 msgr2=0x7f339813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 --2- 172.21.15.119:0/1027822283 >> v2:172.21.15.160:3300/0 conn(0x7f339813eba0 0x7f339813f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f3397400640 1 -- 172.21.15.119:0/1027822283 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980b5fb0 con 0x7f33980b4410 2024-03-08T21:33:57.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.798+0000 7f338ea00640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 0x7f33980b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:57.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f3397400640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b4410 0x7f33980b32e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3398073090 tx=0x7f338801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc5ca4c91b5b7b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f3396a00640 1 -- 172.21.15.119:0/1027822283 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880b0070 con 0x7f33980b4410 2024-03-08T21:33:57.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f3396a00640 1 -- 172.21.15.119:0/1027822283 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33880ab600 con 0x7f33980b4410 2024-03-08T21:33:57.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f3396a00640 1 -- 172.21.15.119:0/1027822283 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880ab9d0 con 0x7f33980b4410 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 -- 172.21.15.119:0/1027822283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b4410 msgr2=0x7f33980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b4410 0x7f33980b32e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3398073090 tx=0x7f338801c520 comp rx=0 tx=0).stop 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 -- 172.21.15.119:0/1027822283 shutdown_connections 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 --2- 172.21.15.119:0/1027822283 >> v2:172.21.15.160:3300/0 conn(0x7f339813eba0 0x7f339813f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b47f0 0x7f33980b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 --2- 172.21.15.119:0/1027822283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b4410 0x7f33980b32e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 -- 172.21.15.119:0/1027822283 >> 172.21.15.119:0/1027822283 conn(0x7f339806b6e0 msgr2=0x7f33980ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 -- 172.21.15.119:0/1027822283 shutdown_connections 2024-03-08T21:33:57.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.802+0000 7f339e600640 1 -- 172.21.15.119:0/1027822283 wait complete. 2024-03-08T21:33:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 Processor -- start 2024-03-08T21:33:57.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- start start 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b4410 0x7f339806c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f339813eba0 0x7f3398131d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398148b30 con 0x7f33980b47f0 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398148cb0 con 0x7f339813eba0 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398148e30 con 0x7f33980b4410 2024-03-08T21:33:57.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43980/0 (socket says 172.21.15.119:43980) 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 -- 172.21.15.119:0/4281633741 learned_addr learned my addr 172.21.15.119:0/4281633741 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f3397400640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b4410 0x7f339806c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f3397e00640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f339813eba0 0x7f3398131d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 -- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b4410 msgr2=0x7f339806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b4410 0x7f339806c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 -- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f339813eba0 msgr2=0x7f3398131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f339813eba0 0x7f3398131d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 -- 172.21.15.119:0/4281633741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339806d2b0 con 0x7f33980b47f0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338ea00640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f338000cf80 tx=0x7f338000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338001a070 con 0x7f33980b47f0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000d840 con 0x7f33980b47f0 2024-03-08T21:33:57.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000dc30 con 0x7f33980b47f0 2024-03-08T21:33:57.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33980b93c0 con 0x7f33980b47f0 2024-03-08T21:33:57.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339806d520 con 0x7f33980b47f0 2024-03-08T21:33:57.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.806+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398067db0 con 0x7f33980b47f0 2024-03-08T21:33:57.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.810+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f338001d070 con 0x7f33980b47f0 2024-03-08T21:33:57.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.810+0000 7f338fe00640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 0x7f3374069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:57.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.810+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3380085ff0 con 0x7f33980b47f0 2024-03-08T21:33:57.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.810+0000 7f3397400640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 0x7f3374069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:57.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.810+0000 7f3397400640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 0x7f3374069b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f33880ad000 tx=0x7f33880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:57.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.814+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f33800566a0 con 0x7f33980b47f0 2024-03-08T21:33:57.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.966+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f339813c7d0 con 0x7f3374067660 2024-03-08T21:33:57.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.970+0000 7f338fe00640 1 -- 172.21.15.119:0/4281633741 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f339813c7d0 con 0x7f3374067660 2024-03-08T21:33:57.960 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:57.961 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:33:57.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 msgr2=0x7f3374069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 0x7f3374069b20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f33880ad000 tx=0x7f33880a6000 comp rx=0 tx=0).stop 2024-03-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 msgr2=0x7f33980b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f338000cf80 tx=0x7f338000a710 comp rx=0 tx=0).stop 2024-03-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 shutdown_connections 2024-03-08T21:33:57.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3374067660 0x7f3374069b20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f339813eba0 0x7f3398131d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33980b47f0 0x7f33980b9ea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 --2- 172.21.15.119:0/4281633741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33980b4410 0x7f339806c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 >> 172.21.15.119:0/4281633741 conn(0x7f339806b6e0 msgr2=0x7f339813ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 shutdown_connections 2024-03-08T21:33:57.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:57.974+0000 7f339e600640 1 -- 172.21.15.119:0/4281633741 wait complete. 2024-03-08T21:33:57.979 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-08T21:33:56.417325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223204,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751516,"statfs":{"total":773094113280,"available":772865552384,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001501"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662084+0000","last_change":"2024-03-08T21:33:49.338396+0000","last_active":"2024-03-08T21:33:50.662084+0000","last_peered":"2024-03-08T21:33:50.662084+0000","last_clean":"2024-03-08T21:33:50.662084+0000","last_became_active":"2024-03-08T21:33:49.336412+0000","last_became_peered":"2024-03-08T21:33:49.336412+0000","last_unstale":"2024-03-08T21:33:50.662084+0000","last_undegraded":"2024-03-08T21:33:50.662084+0000","last_fullsized":"2024-03-08T21:33:50.662084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:11:13.810022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328479+0000","last_change":"2024-03-08T21:33:49.346755+0000","last_active":"2024-03-08T21:33:50.328479+0000","last_peered":"2024-03-08T21:33:50.328479+0000","last_clean":"2024-03-08T21:33:50.328479+0000","last_became_active":"2024-03-08T21:33:49.345880+0000","last_became_peered":"2024-03-08T21:33:49.345880+0000","last_unstale":"2024-03-08T21:33:50.328479+0000","last_undegraded":"2024-03-08T21:33:50.328479+0000","last_fullsized":"2024-03-08T21:33:50.328479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661694+0000","last_change":"2024-03-08T21:33:49.352136+0000","last_active":"2024-03-08T21:33:50.661694+0000","last_peered":"2024-03-08T21:33:50.661694+0000","last_clean":"2024-03-08T21:33:50.661694+0000","last_became_active":"2024-03-08T21:33:49.351873+0000","last_became_peered":"2024-03-08T21:33:49.351873+0000","last_unstale":"2024-03-08T21:33:50.661694+0000","last_undegraded":"2024-03-08T21:33:50.661694+0000","last_fullsized":"2024-03-08T21:33:50.661694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:01:49.384719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661005+0000","last_change":"2024-03-08T21:33:49.345377+0000","last_active":"2024-03-08T21:33:50.661005+0000","last_peered":"2024-03-08T21:33:50.661005+0000","last_clean":"2024-03-08T21:33:50.661005+0000","last_became_active":"2024-03-08T21:33:49.344753+0000","last_became_peered":"2024-03-08T21:33:49.344753+0000","last_unstale":"2024-03-08T21:33:50.661005+0000","last_undegraded":"2024-03-08T21:33:50.661005+0000","last_fullsized":"2024-03-08T21:33:50.661005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661529+0000","last_change":"2024-03-08T21:33:49.335919+0000","last_active":"2024-03-08T21:33:50.661529+0000","last_peered":"2024-03-08T21:33:50.661529+0000","last_clean":"2024-03-08T21:33:50.661529+0000","last_became_active":"2024-03-08T21:33:49.335616+0000","last_became_peered":"2024-03-08T21:33:49.335616+0000","last_unstale":"2024-03-08T21:33:50.661529+0000","last_undegraded":"2024-03-08T21:33:50.661529+0000","last_fullsized":"2024-03-08T21:33:50.661529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660638+0000","last_change":"2024-03-08T21:33:49.349339+0000","last_active":"2024-03-08T21:33:50.660638+0000","last_peered":"2024-03-08T21:33:50.660638+0000","last_clean":"2024-03-08T21:33:50.660638+0000","last_became_active":"2024-03-08T21:33:49.348932+0000","last_became_peered":"2024-03-08T21:33:49.348932+0000","last_unstale":"2024-03-08T21:33:50.660638+0000","last_undegraded":"2024-03-08T21:33:50.660638+0000","last_fullsized":"2024-03-08T21:33:50.660638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661041+0000","last_change":"2024-03-08T21:33:49.327740+0000","last_active":"2024-03-08T21:33:50.661041+0000","last_peered":"2024-03-08T21:33:50.661041+0000","last_clean":"2024-03-08T21:33:50.661041+0000","last_became_active":"2024-03-08T21:33:49.327434+0000","last_became_peered":"2024-03-08T21:33:49.327434+0000","last_unstale":"2024-03-08T21:33:50.661041+0000","last_undegraded":"2024-03-08T21:33:50.661041+0000","last_fullsized":"2024-03-08T21:33:50.661041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660493+0000","last_change":"2024-03-08T21:33:49.336284+0000","last_active":"2024-03-08T21:33:50.660493+0000","last_peered":"2024-03-08T21:33:50.660493+0000","last_clean":"2024-03-08T21:33:50.660493+0000","last_became_active":"2024-03-08T21:33:49.335990+0000","last_became_peered":"2024-03-08T21:33:49.335990+0000","last_unstale":"2024-03-08T21:33:50.660493+0000","last_undegraded":"2024-03-08T21:33:50.660493+0000","last_fullsized":"2024-03-08T21:33:50.660493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662091+0000","last_change":"2024-03-08T21:33:49.337931+0000","last_active":"2024-03-08T21:33:50.662091+0000","last_peered":"2024-03-08T21:33:50.662091+0000","last_clean":"2024-03-08T21:33:50.662091+0000","last_became_active":"2024-03-08T21:33:49.337076+0000","last_became_peered":"2024-03-08T21:33:49.337076+0000","last_unstale":"2024-03-08T21:33:50.662091+0000","last_undegraded":"2024-03-08T21:33:50.662091+0000","last_fullsized":"2024-03-08T21:33:50.662091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:31:33.742418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335718+0000","last_change":"2024-03-08T21:33:49.334835+0000","last_active":"2024-03-08T21:33:50.335718+0000","last_peered":"2024-03-08T21:33:50.335718+0000","last_clean":"2024-03-08T21:33:50.335718+0000","last_became_active":"2024-03-08T21:33:49.334522+0000","last_became_peered":"2024-03-08T21:33:49.334522+0000","last_unstale":"2024-03-08T21:33:50.335718+0000","last_undegraded":"2024-03-08T21:33:50.335718+0000","last_fullsized":"2024-03-08T21:33:50.335718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335412+0000","last_change":"2024-03-08T21:33:49.340915+0000","last_active":"2024-03-08T21:33:50.335412+0000","last_peered":"2024-03-08T21:33:50.335412+0000","last_clean":"2024-03-08T21:33:50.335412+0000","last_became_active":"2024-03-08T21:33:49.340639+0000","last_became_peered":"2024-03-08T21:33:49.340639+0000","last_unstale":"2024-03-08T21:33:50.335412+0000","last_undegraded":"2024-03-08T21:33:50.335412+0000","last_fullsized":"2024-03-08T21:33:50.335412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328707+0000","last_change":"2024-03-08T21:33:49.332751+0000","last_active":"2024-03-08T21:33:50.328707+0000","last_peered":"2024-03-08T21:33:50.328707+0000","last_clean":"2024-03-08T21:33:50.328707+0000","last_became_active":"2024-03-08T21:33:49.332402+0000","last_became_peered":"2024-03-08T21:33:49.332402+0000","last_unstale":"2024-03-08T21:33:50.328707+0000","last_undegraded":"2024-03-08T21:33:50.328707+0000","last_fullsized":"2024-03-08T21:33:50.328707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:15:32.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660711+0000","last_change":"2024-03-08T21:33:49.330189+0000","last_active":"2024-03-08T21:33:50.660711+0000","last_peered":"2024-03-08T21:33:50.660711+0000","last_clean":"2024-03-08T21:33:50.660711+0000","last_became_active":"2024-03-08T21:33:49.327014+0000","last_became_peered":"2024-03-08T21:33:49.327014+0000","last_unstale":"2024-03-08T21:33:50.660711+0000","last_undegraded":"2024-03-08T21:33:50.660711+0000","last_fullsized":"2024-03-08T21:33:50.660711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660963+0000","last_change":"2024-03-08T21:33:49.341331+0000","last_active":"2024-03-08T21:33:50.660963+0000","last_peered":"2024-03-08T21:33:50.660963+0000","last_clean":"2024-03-08T21:33:50.660963+0000","last_became_active":"2024-03-08T21:33:49.341071+0000","last_became_peered":"2024-03-08T21:33:49.341071+0000","last_unstale":"2024-03-08T21:33:50.660963+0000","last_undegraded":"2024-03-08T21:33:50.660963+0000","last_fullsized":"2024-03-08T21:33:50.660963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:41:07.093996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328180+0000","last_change":"2024-03-08T21:33:49.333262+0000","last_active":"2024-03-08T21:33:50.328180+0000","last_peered":"2024-03-08T21:33:50.328180+0000","last_clean":"2024-03-08T21:33:50.328180+0000","last_became_active":"2024-03-08T21:33:49.332938+0000","last_became_peered":"2024-03-08T21:33:49.332938+0000","last_unstale":"2024-03-08T21:33:50.328180+0000","last_undegraded":"2024-03-08T21:33:50.328180+0000","last_fullsized":"2024-03-08T21:33:50.328180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660459+0000","last_change":"2024-03-08T21:33:49.349412+0000","last_active":"2024-03-08T21:33:50.660459+0000","last_peered":"2024-03-08T21:33:50.660459+0000","last_clean":"2024-03-08T21:33:50.660459+0000","last_became_active":"2024-03-08T21:33:49.349101+0000","last_became_peered":"2024-03-08T21:33:49.349101+0000","last_unstale":"2024-03-08T21:33:50.660459+0000","last_undegraded":"2024-03-08T21:33:50.660459+0000","last_fullsized":"2024-03-08T21:33:50.660459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661759+0000","last_change":"2024-03-08T21:33:49.345737+0000","last_active":"2024-03-08T21:33:50.661759+0000","last_peered":"2024-03-08T21:33:50.661759+0000","last_clean":"2024-03-08T21:33:50.661759+0000","last_became_active":"2024-03-08T21:33:49.345326+0000","last_became_peered":"2024-03-08T21:33:49.345326+0000","last_unstale":"2024-03-08T21:33:50.661759+0000","last_undegraded":"2024-03-08T21:33:50.661759+0000","last_fullsized":"2024-03-08T21:33:50.661759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:55:19.344690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328855+0000","last_change":"2024-03-08T21:33:49.341768+0000","last_active":"2024-03-08T21:33:50.328855+0000","last_peered":"2024-03-08T21:33:50.328855+0000","last_clean":"2024-03-08T21:33:50.328855+0000","last_became_active":"2024-03-08T21:33:49.340834+0000","last_became_peered":"2024-03-08T21:33:49.340834+0000","last_unstale":"2024-03-08T21:33:50.328855+0000","last_undegraded":"2024-03-08T21:33:50.328855+0000","last_fullsized":"2024-03-08T21:33:50.328855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662070+0000","last_change":"2024-03-08T21:33:49.351201+0000","last_active":"2024-03-08T21:33:50.662070+0000","last_peered":"2024-03-08T21:33:50.662070+0000","last_clean":"2024-03-08T21:33:50.662070+0000","last_became_active":"2024-03-08T21:33:49.350871+0000","last_became_peered":"2024-03-08T21:33:49.350871+0000","last_unstale":"2024-03-08T21:33:50.662070+0000","last_undegraded":"2024-03-08T21:33:50.662070+0000","last_fullsized":"2024-03-08T21:33:50.662070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:37:11.752417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335320+0000","last_change":"2024-03-08T21:33:49.333002+0000","last_active":"2024-03-08T21:33:50.335320+0000","last_peered":"2024-03-08T21:33:50.335320+0000","last_clean":"2024-03-08T21:33:50.335320+0000","last_became_active":"2024-03-08T21:33:49.332612+0000","last_became_peered":"2024-03-08T21:33:49.332612+0000","last_unstale":"2024-03-08T21:33:50.335320+0000","last_undegraded":"2024-03-08T21:33:50.335320+0000","last_fullsized":"2024-03-08T21:33:50.335320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661591+0000","last_change":"2024-03-08T21:33:49.325558+0000","last_active":"2024-03-08T21:33:50.661591+0000","last_peered":"2024-03-08T21:33:50.661591+0000","last_clean":"2024-03-08T21:33:50.661591+0000","last_became_active":"2024-03-08T21:33:49.325207+0000","last_became_peered":"2024-03-08T21:33:49.325207+0000","last_unstale":"2024-03-08T21:33:50.661591+0000","last_undegraded":"2024-03-08T21:33:50.661591+0000","last_fullsized":"2024-03-08T21:33:50.661591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:30:52.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660694+0000","last_change":"2024-03-08T21:33:49.345431+0000","last_active":"2024-03-08T21:33:50.660694+0000","last_peered":"2024-03-08T21:33:50.660694+0000","last_clean":"2024-03-08T21:33:50.660694+0000","last_became_active":"2024-03-08T21:33:49.344751+0000","last_became_peered":"2024-03-08T21:33:49.344751+0000","last_unstale":"2024-03-08T21:33:50.660694+0000","last_undegraded":"2024-03-08T21:33:50.660694+0000","last_fullsized":"2024-03-08T21:33:50.660694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660494+0000","last_change":"2024-03-08T21:33:49.329867+0000","last_active":"2024-03-08T21:33:50.660494+0000","last_peered":"2024-03-08T21:33:50.660494+0000","last_clean":"2024-03-08T21:33:50.660494+0000","last_became_active":"2024-03-08T21:33:49.329548+0000","last_became_peered":"2024-03-08T21:33:49.329548+0000","last_unstale":"2024-03-08T21:33:50.660494+0000","last_undegraded":"2024-03-08T21:33:50.660494+0000","last_fullsized":"2024-03-08T21:33:50.660494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660542+0000","last_change":"2024-03-08T21:33:49.343224+0000","last_active":"2024-03-08T21:33:50.660542+0000","last_peered":"2024-03-08T21:33:50.660542+0000","last_clean":"2024-03-08T21:33:50.660542+0000","last_became_active":"2024-03-08T21:33:49.342845+0000","last_became_peered":"2024-03-08T21:33:49.342845+0000","last_unstale":"2024-03-08T21:33:50.660542+0000","last_undegraded":"2024-03-08T21:33:50.660542+0000","last_fullsized":"2024-03-08T21:33:50.660542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661216+0000","last_change":"2024-03-08T21:33:49.338081+0000","last_active":"2024-03-08T21:33:50.661216+0000","last_peered":"2024-03-08T21:33:50.661216+0000","last_clean":"2024-03-08T21:33:50.661216+0000","last_became_active":"2024-03-08T21:33:49.337826+0000","last_became_peered":"2024-03-08T21:33:49.337826+0000","last_unstale":"2024-03-08T21:33:50.661216+0000","last_undegraded":"2024-03-08T21:33:50.661216+0000","last_fullsized":"2024-03-08T21:33:50.661216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335721+0000","last_change":"2024-03-08T21:33:49.343833+0000","last_active":"2024-03-08T21:33:50.335721+0000","last_peered":"2024-03-08T21:33:50.335721+0000","last_clean":"2024-03-08T21:33:50.335721+0000","last_became_active":"2024-03-08T21:33:49.342474+0000","last_became_peered":"2024-03-08T21:33:49.342474+0000","last_unstale":"2024-03-08T21:33:50.335721+0000","last_undegraded":"2024-03-08T21:33:50.335721+0000","last_fullsized":"2024-03-08T21:33:50.335721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328615+0000","last_change":"2024-03-08T21:33:49.344117+0000","last_active":"2024-03-08T21:33:50.328615+0000","last_peered":"2024-03-08T21:33:50.328615+0000","last_clean":"2024-03-08T21:33:50.328615+0000","last_became_active":"2024-03-08T21:33:49.343840+0000","last_became_peered":"2024-03-08T21:33:49.343840+0000","last_unstale":"2024-03-08T21:33:50.328615+0000","last_undegraded":"2024-03-08T21:33:50.328615+0000","last_fullsized":"2024-03-08T21:33:50.328615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661224+0000","last_change":"2024-03-08T21:33:49.338130+0000","last_active":"2024-03-08T21:33:50.661224+0000","last_peered":"2024-03-08T21:33:50.661224+0000","last_clean":"2024-03-08T21:33:50.661224+0000","last_became_active":"2024-03-08T21:33:49.337923+0000","last_became_peered":"2024-03-08T21:33:49.337923+0000","last_unstale":"2024-03-08T21:33:50.661224+0000","last_undegraded":"2024-03-08T21:33:50.661224+0000","last_fullsized":"2024-03-08T21:33:50.661224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661619+0000","last_change":"2024-03-08T21:33:49.338988+0000","last_active":"2024-03-08T21:33:50.661619+0000","last_peered":"2024-03-08T21:33:50.661619+0000","last_clean":"2024-03-08T21:33:50.661619+0000","last_became_active":"2024-03-08T21:33:49.338156+0000","last_became_peered":"2024-03-08T21:33:49.338156+0000","last_unstale":"2024-03-08T21:33:50.661619+0000","last_undegraded":"2024-03-08T21:33:50.661619+0000","last_fullsized":"2024-03-08T21:33:50.661619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:51:19.989495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660829+0000","last_change":"2024-03-08T21:33:49.345748+0000","last_active":"2024-03-08T21:33:50.660829+0000","last_peered":"2024-03-08T21:33:50.660829+0000","last_clean":"2024-03-08T21:33:50.660829+0000","last_became_active":"2024-03-08T21:33:49.345428+0000","last_became_peered":"2024-03-08T21:33:49.345428+0000","last_unstale":"2024-03-08T21:33:50.660829+0000","last_undegraded":"2024-03-08T21:33:50.660829+0000","last_fullsized":"2024-03-08T21:33:50.660829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:31:33.742418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328975+0000","last_change":"2024-03-08T21:33:49.338873+0000","last_active":"2024-03-08T21:33:50.328975+0000","last_peered":"2024-03-08T21:33:50.328975+0000","last_clean":"2024-03-08T21:33:50.328975+0000","last_became_active":"2024-03-08T21:33:49.338055+0000","last_became_peered":"2024-03-08T21:33:49.338055+0000","last_unstale":"2024-03-08T21:33:50.328975+0000","last_undegraded":"2024-03-08T21:33:50.328975+0000","last_fullsized":"2024-03-08T21:33:50.328975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335228+0000","last_change":"2024-03-08T21:33:49.326802+0000","last_active":"2024-03-08T21:33:50.335228+0000","last_peered":"2024-03-08T21:33:50.335228+0000","last_clean":"2024-03-08T21:33:50.335228+0000","last_became_active":"2024-03-08T21:33:49.326507+0000","last_became_peered":"2024-03-08T21:33:49.326507+0000","last_unstale":"2024-03-08T21:33:50.335228+0000","last_undegraded":"2024-03-08T21:33:50.335228+0000","last_fullsized":"2024-03-08T21:33:50.335228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328323+0000","last_change":"2024-03-08T21:33:49.332694+0000","last_active":"2024-03-08T21:33:50.328323+0000","last_peered":"2024-03-08T21:33:50.328323+0000","last_clean":"2024-03-08T21:33:50.328323+0000","last_became_active":"2024-03-08T21:33:49.332330+0000","last_became_peered":"2024-03-08T21:33:49.332330+0000","last_unstale":"2024-03-08T21:33:50.328323+0000","last_undegraded":"2024-03-08T21:33:50.328323+0000","last_fullsized":"2024-03-08T21:33:50.328323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:39.246275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660986+0000","last_change":"2024-03-08T21:33:48.318511+0000","last_active":"2024-03-08T21:33:50.660986+0000","last_peered":"2024-03-08T21:33:50.660986+0000","last_clean":"2024-03-08T21:33:50.660986+0000","last_became_active":"2024-03-08T21:33:48.318248+0000","last_became_peered":"2024-03-08T21:33:48.318248+0000","last_unstale":"2024-03-08T21:33:50.660986+0000","last_undegraded":"2024-03-08T21:33:50.660986+0000","last_fullsized":"2024-03-08T21:33:50.660986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:41.855784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661740+0000","last_change":"2024-03-08T21:33:49.336639+0000","last_active":"2024-03-08T21:33:50.661740+0000","last_peered":"2024-03-08T21:33:50.661740+0000","last_clean":"2024-03-08T21:33:50.661740+0000","last_became_active":"2024-03-08T21:33:49.336391+0000","last_became_peered":"2024-03-08T21:33:49.336391+0000","last_unstale":"2024-03-08T21:33:50.661740+0000","last_undegraded":"2024-03-08T21:33:50.661740+0000","last_fullsized":"2024-03-08T21:33:50.661740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:14.440484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335233+0000","last_change":"2024-03-08T21:33:48.319438+0000","last_active":"2024-03-08T21:33:50.335233+0000","last_peered":"2024-03-08T21:33:50.335233+0000","last_clean":"2024-03-08T21:33:50.335233+0000","last_became_active":"2024-03-08T21:33:48.319140+0000","last_became_peered":"2024-03-08T21:33:48.319140+0000","last_unstale":"2024-03-08T21:33:50.335233+0000","last_undegraded":"2024-03-08T21:33:50.335233+0000","last_fullsized":"2024-03-08T21:33:50.335233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660609+0000","last_change":"2024-03-08T21:33:48.320554+0000","last_active":"2024-03-08T21:33:50.660609+0000","last_peered":"2024-03-08T21:33:50.660609+0000","last_clean":"2024-03-08T21:33:50.660609+0000","last_became_active":"2024-03-08T21:33:48.320236+0000","last_became_peered":"2024-03-08T21:33:48.320236+0000","last_unstale":"2024-03-08T21:33:50.660609+0000","last_undegraded":"2024-03-08T21:33:50.660609+0000","last_fullsized":"2024-03-08T21:33:50.660609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:54.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660569+0000","last_change":"2024-03-08T21:33:49.329537+0000","last_active":"2024-03-08T21:33:50.660569+0000","last_peered":"2024-03-08T21:33:50.660569+0000","last_clean":"2024-03-08T21:33:50.660569+0000","last_became_active":"2024-03-08T21:33:49.329235+0000","last_became_peered":"2024-03-08T21:33:49.329235+0000","last_unstale":"2024-03-08T21:33:50.660569+0000","last_undegraded":"2024-03-08T21:33:50.660569+0000","last_fullsized":"2024-03-08T21:33:50.660569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660569+0000","last_change":"2024-03-08T21:33:48.320328+0000","last_active":"2024-03-08T21:33:50.660569+0000","last_peered":"2024-03-08T21:33:50.660569+0000","last_clean":"2024-03-08T21:33:50.660569+0000","last_became_active":"2024-03-08T21:33:48.319881+0000","last_became_peered":"2024-03-08T21:33:48.319881+0000","last_unstale":"2024-03-08T21:33:50.660569+0000","last_undegraded":"2024-03-08T21:33:50.660569+0000","last_fullsized":"2024-03-08T21:33:50.660569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.344229+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.343942+0000","last_became_peered":"2024-03-08T21:33:49.343942+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335604+0000","last_change":"2024-03-08T21:33:48.331439+0000","last_active":"2024-03-08T21:33:50.335604+0000","last_peered":"2024-03-08T21:33:50.335604+0000","last_clean":"2024-03-08T21:33:50.335604+0000","last_became_active":"2024-03-08T21:33:48.331088+0000","last_became_peered":"2024-03-08T21:33:48.331088+0000","last_unstale":"2024-03-08T21:33:50.335604+0000","last_undegraded":"2024-03-08T21:33:50.335604+0000","last_fullsized":"2024-03-08T21:33:50.335604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661299+0000","last_change":"2024-03-08T21:33:49.345091+0000","last_active":"2024-03-08T21:33:50.661299+0000","last_peered":"2024-03-08T21:33:50.661299+0000","last_clean":"2024-03-08T21:33:50.661299+0000","last_became_active":"2024-03-08T21:33:49.344796+0000","last_became_peered":"2024-03-08T21:33:49.344796+0000","last_unstale":"2024-03-08T21:33:50.661299+0000","last_undegraded":"2024-03-08T21:33:50.661299+0000","last_fullsized":"2024-03-08T21:33:50.661299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:37:11.752417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661404+0000","last_change":"2024-03-08T21:33:48.336669+0000","last_active":"2024-03-08T21:33:50.661404+0000","last_peered":"2024-03-08T21:33:50.661404+0000","last_clean":"2024-03-08T21:33:50.661404+0000","last_became_active":"2024-03-08T21:33:48.336403+0000","last_became_peered":"2024-03-08T21:33:48.336403+0000","last_unstale":"2024-03-08T21:33:50.661404+0000","last_undegraded":"2024-03-08T21:33:50.661404+0000","last_fullsized":"2024-03-08T21:33:50.661404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661769+0000","last_change":"2024-03-08T21:33:49.339581+0000","last_active":"2024-03-08T21:33:50.661769+0000","last_peered":"2024-03-08T21:33:50.661769+0000","last_clean":"2024-03-08T21:33:50.661769+0000","last_became_active":"2024-03-08T21:33:49.332498+0000","last_became_peered":"2024-03-08T21:33:49.332498+0000","last_unstale":"2024-03-08T21:33:50.661769+0000","last_undegraded":"2024-03-08T21:33:50.661769+0000","last_fullsized":"2024-03-08T21:33:50.661769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:42:15.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328697+0000","last_change":"2024-03-08T21:33:48.326093+0000","last_active":"2024-03-08T21:33:50.328697+0000","last_peered":"2024-03-08T21:33:50.328697+0000","last_clean":"2024-03-08T21:33:50.328697+0000","last_became_active":"2024-03-08T21:33:48.325836+0000","last_became_peered":"2024-03-08T21:33:48.325836+0000","last_unstale":"2024-03-08T21:33:50.328697+0000","last_undegraded":"2024-03-08T21:33:50.328697+0000","last_fullsized":"2024-03-08T21:33:50.328697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328698+0000","last_change":"2024-03-08T21:33:49.321155+0000","last_active":"2024-03-08T21:33:50.328698+0000","last_peered":"2024-03-08T21:33:50.328698+0000","last_clean":"2024-03-08T21:33:50.328698+0000","last_became_active":"2024-03-08T21:33:49.320883+0000","last_became_peered":"2024-03-08T21:33:49.320883+0000","last_unstale":"2024-03-08T21:33:50.328698+0000","last_undegraded":"2024-03-08T21:33:50.328698+0000","last_fullsized":"2024-03-08T21:33:50.328698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:58.416650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335352+0000","last_change":"2024-03-08T21:33:48.311111+0000","last_active":"2024-03-08T21:33:50.335352+0000","last_peered":"2024-03-08T21:33:50.335352+0000","last_clean":"2024-03-08T21:33:50.335352+0000","last_became_active":"2024-03-08T21:33:48.310608+0000","last_became_peered":"2024-03-08T21:33:48.310608+0000","last_unstale":"2024-03-08T21:33:50.335352+0000","last_undegraded":"2024-03-08T21:33:50.335352+0000","last_fullsized":"2024-03-08T21:33:50.335352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661651+0000","last_change":"2024-03-08T21:33:49.334300+0000","last_active":"2024-03-08T21:33:50.661651+0000","last_peered":"2024-03-08T21:33:50.661651+0000","last_clean":"2024-03-08T21:33:50.661651+0000","last_became_active":"2024-03-08T21:33:49.333906+0000","last_became_peered":"2024-03-08T21:33:49.333906+0000","last_unstale":"2024-03-08T21:33:50.661651+0000","last_undegraded":"2024-03-08T21:33:50.661651+0000","last_fullsized":"2024-03-08T21:33:50.661651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:32:27.626987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661723+0000","last_change":"2024-03-08T21:33:48.316480+0000","last_active":"2024-03-08T21:33:50.661723+0000","last_peered":"2024-03-08T21:33:50.661723+0000","last_clean":"2024-03-08T21:33:50.661723+0000","last_became_active":"2024-03-08T21:33:48.316135+0000","last_became_peered":"2024-03-08T21:33:48.316135+0000","last_unstale":"2024-03-08T21:33:50.661723+0000","last_undegraded":"2024-03-08T21:33:50.661723+0000","last_fullsized":"2024-03-08T21:33:50.661723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:09.644526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661507+0000","last_change":"2024-03-08T21:33:49.324801+0000","last_active":"2024-03-08T21:33:50.661507+0000","last_peered":"2024-03-08T21:33:50.661507+0000","last_clean":"2024-03-08T21:33:50.661507+0000","last_became_active":"2024-03-08T21:33:49.324523+0000","last_became_peered":"2024-03-08T21:33:49.324523+0000","last_unstale":"2024-03-08T21:33:50.661507+0000","last_undegraded":"2024-03-08T21:33:50.661507+0000","last_fullsized":"2024-03-08T21:33:50.661507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:36:35.145970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660829+0000","last_change":"2024-03-08T21:33:48.324724+0000","last_active":"2024-03-08T21:33:50.660829+0000","last_peered":"2024-03-08T21:33:50.660829+0000","last_clean":"2024-03-08T21:33:50.660829+0000","last_became_active":"2024-03-08T21:33:48.324379+0000","last_became_peered":"2024-03-08T21:33:48.324379+0000","last_unstale":"2024-03-08T21:33:50.660829+0000","last_undegraded":"2024-03-08T21:33:50.660829+0000","last_fullsized":"2024-03-08T21:33:50.660829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661599+0000","last_change":"2024-03-08T21:33:49.331839+0000","last_active":"2024-03-08T21:33:50.661599+0000","last_peered":"2024-03-08T21:33:50.661599+0000","last_clean":"2024-03-08T21:33:50.661599+0000","last_became_active":"2024-03-08T21:33:49.329912+0000","last_became_peered":"2024-03-08T21:33:49.329912+0000","last_unstale":"2024-03-08T21:33:50.661599+0000","last_undegraded":"2024-03-08T21:33:50.661599+0000","last_fullsized":"2024-03-08T21:33:50.661599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335165+0000","last_change":"2024-03-08T21:33:48.311849+0000","last_active":"2024-03-08T21:33:50.335165+0000","last_peered":"2024-03-08T21:33:50.335165+0000","last_clean":"2024-03-08T21:33:50.335165+0000","last_became_active":"2024-03-08T21:33:48.310917+0000","last_became_peered":"2024-03-08T21:33:48.310917+0000","last_unstale":"2024-03-08T21:33:50.335165+0000","last_undegraded":"2024-03-08T21:33:50.335165+0000","last_fullsized":"2024-03-08T21:33:50.335165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335308+0000","last_change":"2024-03-08T21:33:49.326937+0000","last_active":"2024-03-08T21:33:50.335308+0000","last_peered":"2024-03-08T21:33:50.335308+0000","last_clean":"2024-03-08T21:33:50.335308+0000","last_became_active":"2024-03-08T21:33:49.326518+0000","last_became_peered":"2024-03-08T21:33:49.326518+0000","last_unstale":"2024-03-08T21:33:50.335308+0000","last_undegraded":"2024-03-08T21:33:50.335308+0000","last_fullsized":"2024-03-08T21:33:50.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328078+0000","last_change":"2024-03-08T21:33:48.318497+0000","last_active":"2024-03-08T21:33:50.328078+0000","last_peered":"2024-03-08T21:33:50.328078+0000","last_clean":"2024-03-08T21:33:50.328078+0000","last_became_active":"2024-03-08T21:33:48.317867+0000","last_became_peered":"2024-03-08T21:33:48.317867+0000","last_unstale":"2024-03-08T21:33:50.328078+0000","last_undegraded":"2024-03-08T21:33:50.328078+0000","last_fullsized":"2024-03-08T21:33:50.328078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661213+0000","last_change":"2024-03-08T21:33:49.329322+0000","last_active":"2024-03-08T21:33:50.661213+0000","last_peered":"2024-03-08T21:33:50.661213+0000","last_clean":"2024-03-08T21:33:50.661213+0000","last_became_active":"2024-03-08T21:33:49.328970+0000","last_became_peered":"2024-03-08T21:33:49.328970+0000","last_unstale":"2024-03-08T21:33:50.661213+0000","last_undegraded":"2024-03-08T21:33:50.661213+0000","last_fullsized":"2024-03-08T21:33:50.661213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329040+0000","last_change":"2024-03-08T21:33:48.313918+0000","last_active":"2024-03-08T21:33:50.329040+0000","last_peered":"2024-03-08T21:33:50.329040+0000","last_clean":"2024-03-08T21:33:50.329040+0000","last_became_active":"2024-03-08T21:33:48.313623+0000","last_became_peered":"2024-03-08T21:33:48.313623+0000","last_unstale":"2024-03-08T21:33:50.329040+0000","last_undegraded":"2024-03-08T21:33:50.329040+0000","last_fullsized":"2024-03-08T21:33:50.329040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:12:02.322314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661706+0000","last_change":"2024-03-08T21:33:49.337361+0000","last_active":"2024-03-08T21:33:50.661706+0000","last_peered":"2024-03-08T21:33:50.661706+0000","last_clean":"2024-03-08T21:33:50.661706+0000","last_became_active":"2024-03-08T21:33:49.337028+0000","last_became_peered":"2024-03-08T21:33:49.337028+0000","last_unstale":"2024-03-08T21:33:50.661706+0000","last_undegraded":"2024-03-08T21:33:50.661706+0000","last_fullsized":"2024-03-08T21:33:50.661706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:15:41.039978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329029+0000","last_change":"2024-03-08T21:33:48.310802+0000","last_active":"2024-03-08T21:33:50.329029+0000","last_peered":"2024-03-08T21:33:50.329029+0000","last_clean":"2024-03-08T21:33:50.329029+0000","last_became_active":"2024-03-08T21:33:48.310508+0000","last_became_peered":"2024-03-08T21:33:48.310508+0000","last_unstale":"2024-03-08T21:33:50.329029+0000","last_undegraded":"2024-03-08T21:33:50.329029+0000","last_fullsized":"2024-03-08T21:33:50.329029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662228+0000","last_change":"2024-03-08T21:33:49.337562+0000","last_active":"2024-03-08T21:33:50.662228+0000","last_peered":"2024-03-08T21:33:50.662228+0000","last_clean":"2024-03-08T21:33:50.662228+0000","last_became_active":"2024-03-08T21:33:49.337051+0000","last_became_peered":"2024-03-08T21:33:49.337051+0000","last_unstale":"2024-03-08T21:33:50.662228+0000","last_undegraded":"2024-03-08T21:33:50.662228+0000","last_fullsized":"2024-03-08T21:33:50.662228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:55:19.344690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328788+0000","last_change":"2024-03-08T21:33:48.319889+0000","last_active":"2024-03-08T21:33:50.328788+0000","last_peered":"2024-03-08T21:33:50.328788+0000","last_clean":"2024-03-08T21:33:50.328788+0000","last_became_active":"2024-03-08T21:33:48.319630+0000","last_became_peered":"2024-03-08T21:33:48.319630+0000","last_unstale":"2024-03-08T21:33:50.328788+0000","last_undegraded":"2024-03-08T21:33:50.328788+0000","last_fullsized":"2024-03-08T21:33:50.328788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661307+0000","last_change":"2024-03-08T21:33:49.345172+0000","last_active":"2024-03-08T21:33:50.661307+0000","last_peered":"2024-03-08T21:33:50.661307+0000","last_clean":"2024-03-08T21:33:50.661307+0000","last_became_active":"2024-03-08T21:33:49.344744+0000","last_became_peered":"2024-03-08T21:33:49.344744+0000","last_unstale":"2024-03-08T21:33:50.661307+0000","last_undegraded":"2024-03-08T21:33:50.661307+0000","last_fullsized":"2024-03-08T21:33:50.661307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:11:13.810022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328849+0000","last_change":"2024-03-08T21:33:48.324914+0000","last_active":"2024-03-08T21:33:50.328849+0000","last_peered":"2024-03-08T21:33:50.328849+0000","last_clean":"2024-03-08T21:33:50.328849+0000","last_became_active":"2024-03-08T21:33:48.324729+0000","last_became_peered":"2024-03-08T21:33:48.324729+0000","last_unstale":"2024-03-08T21:33:50.328849+0000","last_undegraded":"2024-03-08T21:33:50.328849+0000","last_fullsized":"2024-03-08T21:33:50.328849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661742+0000","last_change":"2024-03-08T21:33:49.343068+0000","last_active":"2024-03-08T21:33:50.661742+0000","last_peered":"2024-03-08T21:33:50.661742+0000","last_clean":"2024-03-08T21:33:50.661742+0000","last_became_active":"2024-03-08T21:33:49.342769+0000","last_became_peered":"2024-03-08T21:33:49.342769+0000","last_unstale":"2024-03-08T21:33:50.661742+0000","last_undegraded":"2024-03-08T21:33:50.661742+0000","last_fullsized":"2024-03-08T21:33:50.661742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.091680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660559+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:33:50.660559+0000","last_peered":"2024-03-08T21:33:50.660559+0000","last_clean":"2024-03-08T21:33:50.660559+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:33:50.660559+0000","last_undegraded":"2024-03-08T21:33:50.660559+0000","last_fullsized":"2024-03-08T21:33:50.660559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660771+0000","last_change":"2024-03-08T21:33:48.322277+0000","last_active":"2024-03-08T21:33:50.660771+0000","last_peered":"2024-03-08T21:33:50.660771+0000","last_clean":"2024-03-08T21:33:50.660771+0000","last_became_active":"2024-03-08T21:33:48.321924+0000","last_became_peered":"2024-03-08T21:33:48.321924+0000","last_unstale":"2024-03-08T21:33:50.660771+0000","last_undegraded":"2024-03-08T21:33:50.660771+0000","last_fullsized":"2024-03-08T21:33:50.660771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660803+0000","last_change":"2024-03-08T21:33:49.336954+0000","last_active":"2024-03-08T21:33:50.660803+0000","last_peered":"2024-03-08T21:33:50.660803+0000","last_clean":"2024-03-08T21:33:50.660803+0000","last_became_active":"2024-03-08T21:33:49.336698+0000","last_became_peered":"2024-03-08T21:33:49.336698+0000","last_unstale":"2024-03-08T21:33:50.660803+0000","last_undegraded":"2024-03-08T21:33:50.660803+0000","last_fullsized":"2024-03-08T21:33:50.660803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660474+0000","last_change":"2024-03-08T21:33:48.324162+0000","last_active":"2024-03-08T21:33:50.660474+0000","last_peered":"2024-03-08T21:33:50.660474+0000","last_clean":"2024-03-08T21:33:50.660474+0000","last_became_active":"2024-03-08T21:33:48.323370+0000","last_became_peered":"2024-03-08T21:33:48.323370+0000","last_unstale":"2024-03-08T21:33:50.660474+0000","last_undegraded":"2024-03-08T21:33:50.660474+0000","last_fullsized":"2024-03-08T21:33:50.660474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661478+0000","last_change":"2024-03-08T21:33:49.335670+0000","last_active":"2024-03-08T21:33:50.661478+0000","last_peered":"2024-03-08T21:33:50.661478+0000","last_clean":"2024-03-08T21:33:50.661478+0000","last_became_active":"2024-03-08T21:33:49.335420+0000","last_became_peered":"2024-03-08T21:33:49.335420+0000","last_unstale":"2024-03-08T21:33:50.661478+0000","last_undegraded":"2024-03-08T21:33:50.661478+0000","last_fullsized":"2024-03-08T21:33:50.661478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:55.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328196+0000","last_change":"2024-03-08T21:33:48.304590+0000","last_active":"2024-03-08T21:33:50.328196+0000","last_peered":"2024-03-08T21:33:50.328196+0000","last_clean":"2024-03-08T21:33:50.328196+0000","last_became_active":"2024-03-08T21:33:48.304130+0000","last_became_peered":"2024-03-08T21:33:48.304130+0000","last_unstale":"2024-03-08T21:33:50.328196+0000","last_undegraded":"2024-03-08T21:33:50.328196+0000","last_fullsized":"2024-03-08T21:33:50.328196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.339223+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.338871+0000","last_became_peered":"2024-03-08T21:33:49.338871+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660985+0000","last_change":"2024-03-08T21:33:48.322438+0000","last_active":"2024-03-08T21:33:50.660985+0000","last_peered":"2024-03-08T21:33:50.660985+0000","last_clean":"2024-03-08T21:33:50.660985+0000","last_became_active":"2024-03-08T21:33:48.322161+0000","last_became_peered":"2024-03-08T21:33:48.322161+0000","last_unstale":"2024-03-08T21:33:50.660985+0000","last_undegraded":"2024-03-08T21:33:50.660985+0000","last_fullsized":"2024-03-08T21:33:50.660985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328805+0000","last_change":"2024-03-08T21:33:49.323865+0000","last_active":"2024-03-08T21:33:50.328805+0000","last_peered":"2024-03-08T21:33:50.328805+0000","last_clean":"2024-03-08T21:33:50.328805+0000","last_became_active":"2024-03-08T21:33:49.323330+0000","last_became_peered":"2024-03-08T21:33:49.323330+0000","last_unstale":"2024-03-08T21:33:50.328805+0000","last_undegraded":"2024-03-08T21:33:50.328805+0000","last_fullsized":"2024-03-08T21:33:50.328805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:52:43.691318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328384+0000","last_change":"2024-03-08T21:33:48.317519+0000","last_active":"2024-03-08T21:33:50.328384+0000","last_peered":"2024-03-08T21:33:50.328384+0000","last_clean":"2024-03-08T21:33:50.328384+0000","last_became_active":"2024-03-08T21:33:48.317260+0000","last_became_peered":"2024-03-08T21:33:48.317260+0000","last_unstale":"2024-03-08T21:33:50.328384+0000","last_undegraded":"2024-03-08T21:33:50.328384+0000","last_fullsized":"2024-03-08T21:33:50.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661171+0000","last_change":"2024-03-08T21:33:49.343487+0000","last_active":"2024-03-08T21:33:50.661171+0000","last_peered":"2024-03-08T21:33:50.661171+0000","last_clean":"2024-03-08T21:33:50.661171+0000","last_became_active":"2024-03-08T21:33:49.343231+0000","last_became_peered":"2024-03-08T21:33:49.343231+0000","last_unstale":"2024-03-08T21:33:50.661171+0000","last_undegraded":"2024-03-08T21:33:50.661171+0000","last_fullsized":"2024-03-08T21:33:50.661171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.091680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662057+0000","last_change":"2024-03-08T21:33:48.320355+0000","last_active":"2024-03-08T21:33:50.662057+0000","last_peered":"2024-03-08T21:33:50.662057+0000","last_clean":"2024-03-08T21:33:50.662057+0000","last_became_active":"2024-03-08T21:33:48.320045+0000","last_became_peered":"2024-03-08T21:33:48.320045+0000","last_unstale":"2024-03-08T21:33:50.662057+0000","last_undegraded":"2024-03-08T21:33:50.662057+0000","last_fullsized":"2024-03-08T21:33:50.662057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328590+0000","last_change":"2024-03-08T21:33:49.335152+0000","last_active":"2024-03-08T21:33:50.328590+0000","last_peered":"2024-03-08T21:33:50.328590+0000","last_clean":"2024-03-08T21:33:50.328590+0000","last_became_active":"2024-03-08T21:33:49.334899+0000","last_became_peered":"2024-03-08T21:33:49.334899+0000","last_unstale":"2024-03-08T21:33:50.328590+0000","last_undegraded":"2024-03-08T21:33:50.328590+0000","last_fullsized":"2024-03-08T21:33:50.328590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.334653+0000","last_change":"2024-03-08T21:33:48.321898+0000","last_active":"2024-03-08T21:33:50.334653+0000","last_peered":"2024-03-08T21:33:50.334653+0000","last_clean":"2024-03-08T21:33:50.334653+0000","last_became_active":"2024-03-08T21:33:48.321538+0000","last_became_peered":"2024-03-08T21:33:48.321538+0000","last_unstale":"2024-03-08T21:33:50.334653+0000","last_undegraded":"2024-03-08T21:33:50.334653+0000","last_fullsized":"2024-03-08T21:33:50.334653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661266+0000","last_change":"2024-03-08T21:33:49.329726+0000","last_active":"2024-03-08T21:33:50.661266+0000","last_peered":"2024-03-08T21:33:50.661266+0000","last_clean":"2024-03-08T21:33:50.661266+0000","last_became_active":"2024-03-08T21:33:49.329391+0000","last_became_peered":"2024-03-08T21:33:49.329391+0000","last_unstale":"2024-03-08T21:33:50.661266+0000","last_undegraded":"2024-03-08T21:33:50.661266+0000","last_fullsized":"2024-03-08T21:33:50.661266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335670+0000","last_change":"2024-03-08T21:33:48.321998+0000","last_active":"2024-03-08T21:33:50.335670+0000","last_peered":"2024-03-08T21:33:50.335670+0000","last_clean":"2024-03-08T21:33:50.335670+0000","last_became_active":"2024-03-08T21:33:48.321277+0000","last_became_peered":"2024-03-08T21:33:48.321277+0000","last_unstale":"2024-03-08T21:33:50.335670+0000","last_undegraded":"2024-03-08T21:33:50.335670+0000","last_fullsized":"2024-03-08T21:33:50.335670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661893+0000","last_change":"2024-03-08T21:33:49.340131+0000","last_active":"2024-03-08T21:33:50.661893+0000","last_peered":"2024-03-08T21:33:50.661893+0000","last_clean":"2024-03-08T21:33:50.661893+0000","last_became_active":"2024-03-08T21:33:49.339816+0000","last_became_peered":"2024-03-08T21:33:49.339816+0000","last_unstale":"2024-03-08T21:33:50.661893+0000","last_undegraded":"2024-03-08T21:33:50.661893+0000","last_fullsized":"2024-03-08T21:33:50.661893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:33.225083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660432+0000","last_change":"2024-03-08T21:33:48.316829+0000","last_active":"2024-03-08T21:33:50.660432+0000","last_peered":"2024-03-08T21:33:50.660432+0000","last_clean":"2024-03-08T21:33:50.660432+0000","last_became_active":"2024-03-08T21:33:48.316647+0000","last_became_peered":"2024-03-08T21:33:48.316647+0000","last_unstale":"2024-03-08T21:33:50.660432+0000","last_undegraded":"2024-03-08T21:33:50.660432+0000","last_fullsized":"2024-03-08T21:33:50.660432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328708+0000","last_change":"2024-03-08T21:33:49.335879+0000","last_active":"2024-03-08T21:33:50.328708+0000","last_peered":"2024-03-08T21:33:50.328708+0000","last_clean":"2024-03-08T21:33:50.328708+0000","last_became_active":"2024-03-08T21:33:49.335555+0000","last_became_peered":"2024-03-08T21:33:49.335555+0000","last_unstale":"2024-03-08T21:33:50.328708+0000","last_undegraded":"2024-03-08T21:33:50.328708+0000","last_fullsized":"2024-03-08T21:33:50.328708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:05:04.726067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328130+0000","last_change":"2024-03-08T21:33:48.319210+0000","last_active":"2024-03-08T21:33:50.328130+0000","last_peered":"2024-03-08T21:33:50.328130+0000","last_clean":"2024-03-08T21:33:50.328130+0000","last_became_active":"2024-03-08T21:33:48.318910+0000","last_became_peered":"2024-03-08T21:33:48.318910+0000","last_unstale":"2024-03-08T21:33:50.328130+0000","last_undegraded":"2024-03-08T21:33:50.328130+0000","last_fullsized":"2024-03-08T21:33:50.328130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660686+0000","last_change":"2024-03-08T21:33:49.336542+0000","last_active":"2024-03-08T21:33:50.660686+0000","last_peered":"2024-03-08T21:33:50.660686+0000","last_clean":"2024-03-08T21:33:50.660686+0000","last_became_active":"2024-03-08T21:33:49.336243+0000","last_became_peered":"2024-03-08T21:33:49.336243+0000","last_unstale":"2024-03-08T21:33:50.660686+0000","last_undegraded":"2024-03-08T21:33:50.660686+0000","last_fullsized":"2024-03-08T21:33:50.660686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328488+0000","last_change":"2024-03-08T21:33:48.309925+0000","last_active":"2024-03-08T21:33:50.328488+0000","last_peered":"2024-03-08T21:33:50.328488+0000","last_clean":"2024-03-08T21:33:50.328488+0000","last_became_active":"2024-03-08T21:33:48.309536+0000","last_became_peered":"2024-03-08T21:33:48.309536+0000","last_unstale":"2024-03-08T21:33:50.328488+0000","last_undegraded":"2024-03-08T21:33:50.328488+0000","last_fullsized":"2024-03-08T21:33:50.328488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660752+0000","last_change":"2024-03-08T21:33:49.330871+0000","last_active":"2024-03-08T21:33:50.660752+0000","last_peered":"2024-03-08T21:33:50.660752+0000","last_clean":"2024-03-08T21:33:50.660752+0000","last_became_active":"2024-03-08T21:33:49.330561+0000","last_became_peered":"2024-03-08T21:33:49.330561+0000","last_unstale":"2024-03-08T21:33:50.660752+0000","last_undegraded":"2024-03-08T21:33:50.660752+0000","last_fullsized":"2024-03-08T21:33:50.660752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661709+0000","last_change":"2024-03-08T21:33:48.326317+0000","last_active":"2024-03-08T21:33:50.661709+0000","last_peered":"2024-03-08T21:33:50.661709+0000","last_clean":"2024-03-08T21:33:50.661709+0000","last_became_active":"2024-03-08T21:33:48.325057+0000","last_became_peered":"2024-03-08T21:33:48.325057+0000","last_unstale":"2024-03-08T21:33:50.661709+0000","last_undegraded":"2024-03-08T21:33:50.661709+0000","last_fullsized":"2024-03-08T21:33:50.661709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335298+0000","last_change":"2024-03-08T21:33:49.332013+0000","last_active":"2024-03-08T21:33:50.335298+0000","last_peered":"2024-03-08T21:33:50.335298+0000","last_clean":"2024-03-08T21:33:50.335298+0000","last_became_active":"2024-03-08T21:33:49.331755+0000","last_became_peered":"2024-03-08T21:33:49.331755+0000","last_unstale":"2024-03-08T21:33:50.335298+0000","last_undegraded":"2024-03-08T21:33:50.335298+0000","last_fullsized":"2024-03-08T21:33:50.335298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661096+0000","last_change":"2024-03-08T21:33:49.339645+0000","last_active":"2024-03-08T21:33:50.661096+0000","last_peered":"2024-03-08T21:33:50.661096+0000","last_clean":"2024-03-08T21:33:50.661096+0000","last_became_active":"2024-03-08T21:33:49.339017+0000","last_became_peered":"2024-03-08T21:33:49.339017+0000","last_unstale":"2024-03-08T21:33:50.661096+0000","last_undegraded":"2024-03-08T21:33:50.661096+0000","last_fullsized":"2024-03-08T21:33:50.661096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:15:41.039978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661446+0000","last_change":"2024-03-08T21:33:48.328103+0000","last_active":"2024-03-08T21:33:50.661446+0000","last_peered":"2024-03-08T21:33:50.661446+0000","last_clean":"2024-03-08T21:33:50.661446+0000","last_became_active":"2024-03-08T21:33:48.327722+0000","last_became_peered":"2024-03-08T21:33:48.327722+0000","last_unstale":"2024-03-08T21:33:50.661446+0000","last_undegraded":"2024-03-08T21:33:50.661446+0000","last_fullsized":"2024-03-08T21:33:50.661446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660999+0000","last_change":"2024-03-08T21:33:49.350219+0000","last_active":"2024-03-08T21:33:50.660999+0000","last_peered":"2024-03-08T21:33:50.660999+0000","last_clean":"2024-03-08T21:33:50.660999+0000","last_became_active":"2024-03-08T21:33:49.349972+0000","last_became_peered":"2024-03-08T21:33:49.349972+0000","last_unstale":"2024-03-08T21:33:50.660999+0000","last_undegraded":"2024-03-08T21:33:50.660999+0000","last_fullsized":"2024-03-08T21:33:50.660999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:32:27.626987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661865+0000","last_change":"2024-03-08T21:33:48.325856+0000","last_active":"2024-03-08T21:33:50.661865+0000","last_peered":"2024-03-08T21:33:50.661865+0000","last_clean":"2024-03-08T21:33:50.661865+0000","last_became_active":"2024-03-08T21:33:48.325490+0000","last_became_peered":"2024-03-08T21:33:48.325490+0000","last_unstale":"2024-03-08T21:33:50.661865+0000","last_undegraded":"2024-03-08T21:33:50.661865+0000","last_fullsized":"2024-03-08T21:33:50.661865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661684+0000","last_change":"2024-03-08T21:33:49.334099+0000","last_active":"2024-03-08T21:33:50.661684+0000","last_peered":"2024-03-08T21:33:50.661684+0000","last_clean":"2024-03-08T21:33:50.661684+0000","last_became_active":"2024-03-08T21:33:49.332877+0000","last_became_peered":"2024-03-08T21:33:49.332877+0000","last_unstale":"2024-03-08T21:33:50.661684+0000","last_undegraded":"2024-03-08T21:33:50.661684+0000","last_fullsized":"2024-03-08T21:33:50.661684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:10:30.001559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661182+0000","last_change":"2024-03-08T21:33:48.313081+0000","last_active":"2024-03-08T21:33:50.661182+0000","last_peered":"2024-03-08T21:33:50.661182+0000","last_clean":"2024-03-08T21:33:50.661182+0000","last_became_active":"2024-03-08T21:33:48.312823+0000","last_became_peered":"2024-03-08T21:33:48.312823+0000","last_unstale":"2024-03-08T21:33:50.661182+0000","last_undegraded":"2024-03-08T21:33:50.661182+0000","last_fullsized":"2024-03-08T21:33:50.661182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661180+0000","last_change":"2024-03-08T21:33:49.330331+0000","last_active":"2024-03-08T21:33:50.661180+0000","last_peered":"2024-03-08T21:33:50.661180+0000","last_clean":"2024-03-08T21:33:50.661180+0000","last_became_active":"2024-03-08T21:33:49.330088+0000","last_became_peered":"2024-03-08T21:33:49.330088+0000","last_unstale":"2024-03-08T21:33:50.661180+0000","last_undegraded":"2024-03-08T21:33:50.661180+0000","last_fullsized":"2024-03-08T21:33:50.661180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661851+0000","last_change":"2024-03-08T21:33:48.323630+0000","last_active":"2024-03-08T21:33:50.661851+0000","last_peered":"2024-03-08T21:33:50.661851+0000","last_clean":"2024-03-08T21:33:50.661851+0000","last_became_active":"2024-03-08T21:33:48.323342+0000","last_became_peered":"2024-03-08T21:33:48.323342+0000","last_unstale":"2024-03-08T21:33:50.661851+0000","last_undegraded":"2024-03-08T21:33:50.661851+0000","last_fullsized":"2024-03-08T21:33:50.661851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:50.973279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:33:57.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:33:58.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 Processor -- start 2024-03-08T21:33:58.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 -- start start 2024-03-08T21:33:58.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f44f40b1250 0x7f44f40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f44f4140680 0x7f44f4140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40b1630 con 0x7f44f406be60 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f406d780 con 0x7f44f40b1250 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f3200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f406da40 con 0x7f44f4140680 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f44f40b1250 0x7f44f40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f44f40b1250 0x7f44f40b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43992/0 (socket says 172.21.15.119:43992) 2024-03-08T21:33:58.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 -- 172.21.15.119:0/1547497771 learned_addr learned my addr 172.21.15.119:0/1547497771 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f2800640 1 --2- 172.21.15.119:0/1547497771 >> v2:172.21.15.160:3300/0 conn(0x7f44f4140680 0x7f44f4140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 -- 172.21.15.119:0/1547497771 >> v2:172.21.15.160:3300/0 conn(0x7f44f4140680 msgr2=0x7f44f4140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 --2- 172.21.15.119:0/1547497771 >> v2:172.21.15.160:3300/0 conn(0x7f44f4140680 0x7f44f4140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 -- 172.21.15.119:0/1547497771 >> v1:172.21.15.119:6789/0 conn(0x7f44f406be60 legacy=0x7f44f40b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f1e00640 1 -- 172.21.15.119:0/1547497771 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40b64b0 con 0x7f44f40b1250 2024-03-08T21:33:58.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.170+0000 7f44f0a00640 1 -- 172.21.15.119:0/1547497771 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925771844 0 0) 0x7f44f40b1630 con 0x7f44f406be60 2024-03-08T21:33:58.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f1e00640 1 --2- 172.21.15.119:0/1547497771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b5f70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44f40b8300 tx=0x7f44e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ece055e34648fb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f0a00640 1 -- 172.21.15.119:0/1547497771 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40ab430 con 0x7f44f40b1250 2024-03-08T21:33:58.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f0a00640 1 -- 172.21.15.119:0/1547497771 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e40b0070 con 0x7f44f40b1250 2024-03-08T21:33:58.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f0a00640 1 -- 172.21.15.119:0/1547497771 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40ab7f0 con 0x7f44f40b1250 2024-03-08T21:33:58.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- 172.21.15.119:0/1547497771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 msgr2=0x7f44f40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 --2- 172.21.15.119:0/1547497771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b5f70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44f40b8300 tx=0x7f44e401c520 comp rx=0 tx=0).stop 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- 172.21.15.119:0/1547497771 shutdown_connections 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 --2- 172.21.15.119:0/1547497771 >> v2:172.21.15.160:3300/0 conn(0x7f44f4140680 0x7f44f4140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 --2- 172.21.15.119:0/1547497771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b5f70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- 172.21.15.119:0/1547497771 >> 172.21.15.119:0/1547497771 conn(0x7f44f406b4e0 msgr2=0x7f44f40ba450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:58.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- 172.21.15.119:0/1547497771 shutdown_connections 2024-03-08T21:33:58.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- 172.21.15.119:0/1547497771 wait complete. 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 Processor -- start 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 -- start start 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.174+0000 7f44f3200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44f406be60 0x7f44f40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44f4140680 0x7f44f40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4154450 con 0x7f44f40b1250 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41542d0 con 0x7f44f406be60 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41545d0 con 0x7f44f4140680 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44000/0 (socket says 172.21.15.119:44000) 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 -- 172.21.15.119:0/3357190160 learned_addr learned my addr 172.21.15.119:0/3357190160 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:58.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1e00640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44f406be60 0x7f44f40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f2800640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44f4140680 0x7f44f40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 -- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44f4140680 msgr2=0x7f44f40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44f4140680 0x7f44f40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 -- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44f406be60 msgr2=0x7f44f40b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44f406be60 0x7f44f40b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 -- 172.21.15.119:0/3357190160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4147210 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f1400640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44e000c4d0 tx=0x7f44e000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0017070 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0005480 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0003840 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f41e31b0 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f40b0ab0 con 0x7f44f40b1250 2024-03-08T21:33:58.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f40750f0 con 0x7f44f40b1250 2024-03-08T21:33:58.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44e001a070 con 0x7f44f40b1250 2024-03-08T21:33:58.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.178+0000 7f44ea000640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 0x7f44d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.182+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44e0084b30 con 0x7f44f40b1250 2024-03-08T21:33:58.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.182+0000 7f44f1e00640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 0x7f44d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.182+0000 7f44f1e00640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 0x7f44d4069b20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44e40af000 tx=0x7f44e40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.186+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f44e00552b0 con 0x7f44f40b1250 2024-03-08T21:33:58.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.334+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44f406e070 con 0x7f44d4067660 2024-03-08T21:33:58.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.342+0000 7f44ea000640 1 -- 172.21.15.119:0/3357190160 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7f44f406e070 con 0x7f44d4067660 2024-03-08T21:33:58.331 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:58.332 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:33:58.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 msgr2=0x7f44d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 0x7f44d4069b20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f44e40af000 tx=0x7f44e40a7000 comp rx=0 tx=0).stop 2024-03-08T21:33:58.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 msgr2=0x7f44f40b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44e000c4d0 tx=0x7f44e000c990 comp rx=0 tx=0).stop 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 shutdown_connections 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44d4067660 0x7f44d4069b20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44f4140680 0x7f44f40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44f40b1250 0x7f44f40b1e60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 --2- 172.21.15.119:0/3357190160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44f406be60 0x7f44f40b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 >> 172.21.15.119:0/3357190160 conn(0x7f44f406b4e0 msgr2=0x7f44f4073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 shutdown_connections 2024-03-08T21:33:58.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.346+0000 7f44f3200640 1 -- 172.21.15.119:0/3357190160 wait complete. 2024-03-08T21:33:58.351 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-08T21:33:56.417325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223204,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751516,"statfs":{"total":773094113280,"available":772865552384,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001501"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662084+0000","last_change":"2024-03-08T21:33:49.338396+0000","last_active":"2024-03-08T21:33:50.662084+0000","last_peered":"2024-03-08T21:33:50.662084+0000","last_clean":"2024-03-08T21:33:50.662084+0000","last_became_active":"2024-03-08T21:33:49.336412+0000","last_became_peered":"2024-03-08T21:33:49.336412+0000","last_unstale":"2024-03-08T21:33:50.662084+0000","last_undegraded":"2024-03-08T21:33:50.662084+0000","last_fullsized":"2024-03-08T21:33:50.662084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:11:13.810022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328479+0000","last_change":"2024-03-08T21:33:49.346755+0000","last_active":"2024-03-08T21:33:50.328479+0000","last_peered":"2024-03-08T21:33:50.328479+0000","last_clean":"2024-03-08T21:33:50.328479+0000","last_became_active":"2024-03-08T21:33:49.345880+0000","last_became_peered":"2024-03-08T21:33:49.345880+0000","last_unstale":"2024-03-08T21:33:50.328479+0000","last_undegraded":"2024-03-08T21:33:50.328479+0000","last_fullsized":"2024-03-08T21:33:50.328479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661694+0000","last_change":"2024-03-08T21:33:49.352136+0000","last_active":"2024-03-08T21:33:50.661694+0000","last_peered":"2024-03-08T21:33:50.661694+0000","last_clean":"2024-03-08T21:33:50.661694+0000","last_became_active":"2024-03-08T21:33:49.351873+0000","last_became_peered":"2024-03-08T21:33:49.351873+0000","last_unstale":"2024-03-08T21:33:50.661694+0000","last_undegraded":"2024-03-08T21:33:50.661694+0000","last_fullsized":"2024-03-08T21:33:50.661694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:01:49.384719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661005+0000","last_change":"2024-03-08T21:33:49.345377+0000","last_active":"2024-03-08T21:33:50.661005+0000","last_peered":"2024-03-08T21:33:50.661005+0000","last_clean":"2024-03-08T21:33:50.661005+0000","last_became_active":"2024-03-08T21:33:49.344753+0000","last_became_peered":"2024-03-08T21:33:49.344753+0000","last_unstale":"2024-03-08T21:33:50.661005+0000","last_undegraded":"2024-03-08T21:33:50.661005+0000","last_fullsized":"2024-03-08T21:33:50.661005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661529+0000","last_change":"2024-03-08T21:33:49.335919+0000","last_active":"2024-03-08T21:33:50.661529+0000","last_peered":"2024-03-08T21:33:50.661529+0000","last_clean":"2024-03-08T21:33:50.661529+0000","last_became_active":"2024-03-08T21:33:49.335616+0000","last_became_peered":"2024-03-08T21:33:49.335616+0000","last_unstale":"2024-03-08T21:33:50.661529+0000","last_undegraded":"2024-03-08T21:33:50.661529+0000","last_fullsized":"2024-03-08T21:33:50.661529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660638+0000","last_change":"2024-03-08T21:33:49.349339+0000","last_active":"2024-03-08T21:33:50.660638+0000","last_peered":"2024-03-08T21:33:50.660638+0000","last_clean":"2024-03-08T21:33:50.660638+0000","last_became_active":"2024-03-08T21:33:49.348932+0000","last_became_peered":"2024-03-08T21:33:49.348932+0000","last_unstale":"2024-03-08T21:33:50.660638+0000","last_undegraded":"2024-03-08T21:33:50.660638+0000","last_fullsized":"2024-03-08T21:33:50.660638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661041+0000","last_change":"2024-03-08T21:33:49.327740+0000","last_active":"2024-03-08T21:33:50.661041+0000","last_peered":"2024-03-08T21:33:50.661041+0000","last_clean":"2024-03-08T21:33:50.661041+0000","last_became_active":"2024-03-08T21:33:49.327434+0000","last_became_peered":"2024-03-08T21:33:49.327434+0000","last_unstale":"2024-03-08T21:33:50.661041+0000","last_undegraded":"2024-03-08T21:33:50.661041+0000","last_fullsized":"2024-03-08T21:33:50.661041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660493+0000","last_change":"2024-03-08T21:33:49.336284+0000","last_active":"2024-03-08T21:33:50.660493+0000","last_peered":"2024-03-08T21:33:50.660493+0000","last_clean":"2024-03-08T21:33:50.660493+0000","last_became_active":"2024-03-08T21:33:49.335990+0000","last_became_peered":"2024-03-08T21:33:49.335990+0000","last_unstale":"2024-03-08T21:33:50.660493+0000","last_undegraded":"2024-03-08T21:33:50.660493+0000","last_fullsized":"2024-03-08T21:33:50.660493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662091+0000","last_change":"2024-03-08T21:33:49.337931+0000","last_active":"2024-03-08T21:33:50.662091+0000","last_peered":"2024-03-08T21:33:50.662091+0000","last_clean":"2024-03-08T21:33:50.662091+0000","last_became_active":"2024-03-08T21:33:49.337076+0000","last_became_peered":"2024-03-08T21:33:49.337076+0000","last_unstale":"2024-03-08T21:33:50.662091+0000","last_undegraded":"2024-03-08T21:33:50.662091+0000","last_fullsized":"2024-03-08T21:33:50.662091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:31:33.742418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335718+0000","last_change":"2024-03-08T21:33:49.334835+0000","last_active":"2024-03-08T21:33:50.335718+0000","last_peered":"2024-03-08T21:33:50.335718+0000","last_clean":"2024-03-08T21:33:50.335718+0000","last_became_active":"2024-03-08T21:33:49.334522+0000","last_became_peered":"2024-03-08T21:33:49.334522+0000","last_unstale":"2024-03-08T21:33:50.335718+0000","last_undegraded":"2024-03-08T21:33:50.335718+0000","last_fullsized":"2024-03-08T21:33:50.335718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335412+0000","last_change":"2024-03-08T21:33:49.340915+0000","last_active":"2024-03-08T21:33:50.335412+0000","last_peered":"2024-03-08T21:33:50.335412+0000","last_clean":"2024-03-08T21:33:50.335412+0000","last_became_active":"2024-03-08T21:33:49.340639+0000","last_became_peered":"2024-03-08T21:33:49.340639+0000","last_unstale":"2024-03-08T21:33:50.335412+0000","last_undegraded":"2024-03-08T21:33:50.335412+0000","last_fullsized":"2024-03-08T21:33:50.335412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328707+0000","last_change":"2024-03-08T21:33:49.332751+0000","last_active":"2024-03-08T21:33:50.328707+0000","last_peered":"2024-03-08T21:33:50.328707+0000","last_clean":"2024-03-08T21:33:50.328707+0000","last_became_active":"2024-03-08T21:33:49.332402+0000","last_became_peered":"2024-03-08T21:33:49.332402+0000","last_unstale":"2024-03-08T21:33:50.328707+0000","last_undegraded":"2024-03-08T21:33:50.328707+0000","last_fullsized":"2024-03-08T21:33:50.328707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:15:32.315750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660711+0000","last_change":"2024-03-08T21:33:49.330189+0000","last_active":"2024-03-08T21:33:50.660711+0000","last_peered":"2024-03-08T21:33:50.660711+0000","last_clean":"2024-03-08T21:33:50.660711+0000","last_became_active":"2024-03-08T21:33:49.327014+0000","last_became_peered":"2024-03-08T21:33:49.327014+0000","last_unstale":"2024-03-08T21:33:50.660711+0000","last_undegraded":"2024-03-08T21:33:50.660711+0000","last_fullsized":"2024-03-08T21:33:50.660711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660963+0000","last_change":"2024-03-08T21:33:49.341331+0000","last_active":"2024-03-08T21:33:50.660963+0000","last_peered":"2024-03-08T21:33:50.660963+0000","last_clean":"2024-03-08T21:33:50.660963+0000","last_became_active":"2024-03-08T21:33:49.341071+0000","last_became_peered":"2024-03-08T21:33:49.341071+0000","last_unstale":"2024-03-08T21:33:50.660963+0000","last_undegraded":"2024-03-08T21:33:50.660963+0000","last_fullsized":"2024-03-08T21:33:50.660963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:41:07.093996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328180+0000","last_change":"2024-03-08T21:33:49.333262+0000","last_active":"2024-03-08T21:33:50.328180+0000","last_peered":"2024-03-08T21:33:50.328180+0000","last_clean":"2024-03-08T21:33:50.328180+0000","last_became_active":"2024-03-08T21:33:49.332938+0000","last_became_peered":"2024-03-08T21:33:49.332938+0000","last_unstale":"2024-03-08T21:33:50.328180+0000","last_undegraded":"2024-03-08T21:33:50.328180+0000","last_fullsized":"2024-03-08T21:33:50.328180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660459+0000","last_change":"2024-03-08T21:33:49.349412+0000","last_active":"2024-03-08T21:33:50.660459+0000","last_peered":"2024-03-08T21:33:50.660459+0000","last_clean":"2024-03-08T21:33:50.660459+0000","last_became_active":"2024-03-08T21:33:49.349101+0000","last_became_peered":"2024-03-08T21:33:49.349101+0000","last_unstale":"2024-03-08T21:33:50.660459+0000","last_undegraded":"2024-03-08T21:33:50.660459+0000","last_fullsized":"2024-03-08T21:33:50.660459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661759+0000","last_change":"2024-03-08T21:33:49.345737+0000","last_active":"2024-03-08T21:33:50.661759+0000","last_peered":"2024-03-08T21:33:50.661759+0000","last_clean":"2024-03-08T21:33:50.661759+0000","last_became_active":"2024-03-08T21:33:49.345326+0000","last_became_peered":"2024-03-08T21:33:49.345326+0000","last_unstale":"2024-03-08T21:33:50.661759+0000","last_undegraded":"2024-03-08T21:33:50.661759+0000","last_fullsized":"2024-03-08T21:33:50.661759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:55:19.344690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328855+0000","last_change":"2024-03-08T21:33:49.341768+0000","last_active":"2024-03-08T21:33:50.328855+0000","last_peered":"2024-03-08T21:33:50.328855+0000","last_clean":"2024-03-08T21:33:50.328855+0000","last_became_active":"2024-03-08T21:33:49.340834+0000","last_became_peered":"2024-03-08T21:33:49.340834+0000","last_unstale":"2024-03-08T21:33:50.328855+0000","last_undegraded":"2024-03-08T21:33:50.328855+0000","last_fullsized":"2024-03-08T21:33:50.328855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:51:19.353433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662070+0000","last_change":"2024-03-08T21:33:49.351201+0000","last_active":"2024-03-08T21:33:50.662070+0000","last_peered":"2024-03-08T21:33:50.662070+0000","last_clean":"2024-03-08T21:33:50.662070+0000","last_became_active":"2024-03-08T21:33:49.350871+0000","last_became_peered":"2024-03-08T21:33:49.350871+0000","last_unstale":"2024-03-08T21:33:50.662070+0000","last_undegraded":"2024-03-08T21:33:50.662070+0000","last_fullsized":"2024-03-08T21:33:50.662070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:37:11.752417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335320+0000","last_change":"2024-03-08T21:33:49.333002+0000","last_active":"2024-03-08T21:33:50.335320+0000","last_peered":"2024-03-08T21:33:50.335320+0000","last_clean":"2024-03-08T21:33:50.335320+0000","last_became_active":"2024-03-08T21:33:49.332612+0000","last_became_peered":"2024-03-08T21:33:49.332612+0000","last_unstale":"2024-03-08T21:33:50.335320+0000","last_undegraded":"2024-03-08T21:33:50.335320+0000","last_fullsized":"2024-03-08T21:33:50.335320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661591+0000","last_change":"2024-03-08T21:33:49.325558+0000","last_active":"2024-03-08T21:33:50.661591+0000","last_peered":"2024-03-08T21:33:50.661591+0000","last_clean":"2024-03-08T21:33:50.661591+0000","last_became_active":"2024-03-08T21:33:49.325207+0000","last_became_peered":"2024-03-08T21:33:49.325207+0000","last_unstale":"2024-03-08T21:33:50.661591+0000","last_undegraded":"2024-03-08T21:33:50.661591+0000","last_fullsized":"2024-03-08T21:33:50.661591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:30:52.974840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660694+0000","last_change":"2024-03-08T21:33:49.345431+0000","last_active":"2024-03-08T21:33:50.660694+0000","last_peered":"2024-03-08T21:33:50.660694+0000","last_clean":"2024-03-08T21:33:50.660694+0000","last_became_active":"2024-03-08T21:33:49.344751+0000","last_became_peered":"2024-03-08T21:33:49.344751+0000","last_unstale":"2024-03-08T21:33:50.660694+0000","last_undegraded":"2024-03-08T21:33:50.660694+0000","last_fullsized":"2024-03-08T21:33:50.660694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660494+0000","last_change":"2024-03-08T21:33:49.329867+0000","last_active":"2024-03-08T21:33:50.660494+0000","last_peered":"2024-03-08T21:33:50.660494+0000","last_clean":"2024-03-08T21:33:50.660494+0000","last_became_active":"2024-03-08T21:33:49.329548+0000","last_became_peered":"2024-03-08T21:33:49.329548+0000","last_unstale":"2024-03-08T21:33:50.660494+0000","last_undegraded":"2024-03-08T21:33:50.660494+0000","last_fullsized":"2024-03-08T21:33:50.660494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:03:31.760647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660542+0000","last_change":"2024-03-08T21:33:49.343224+0000","last_active":"2024-03-08T21:33:50.660542+0000","last_peered":"2024-03-08T21:33:50.660542+0000","last_clean":"2024-03-08T21:33:50.660542+0000","last_became_active":"2024-03-08T21:33:49.342845+0000","last_became_peered":"2024-03-08T21:33:49.342845+0000","last_unstale":"2024-03-08T21:33:50.660542+0000","last_undegraded":"2024-03-08T21:33:50.660542+0000","last_fullsized":"2024-03-08T21:33:50.660542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661216+0000","last_change":"2024-03-08T21:33:49.338081+0000","last_active":"2024-03-08T21:33:50.661216+0000","last_peered":"2024-03-08T21:33:50.661216+0000","last_clean":"2024-03-08T21:33:50.661216+0000","last_became_active":"2024-03-08T21:33:49.337826+0000","last_became_peered":"2024-03-08T21:33:49.337826+0000","last_unstale":"2024-03-08T21:33:50.661216+0000","last_undegraded":"2024-03-08T21:33:50.661216+0000","last_fullsized":"2024-03-08T21:33:50.661216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335721+0000","last_change":"2024-03-08T21:33:49.343833+0000","last_active":"2024-03-08T21:33:50.335721+0000","last_peered":"2024-03-08T21:33:50.335721+0000","last_clean":"2024-03-08T21:33:50.335721+0000","last_became_active":"2024-03-08T21:33:49.342474+0000","last_became_peered":"2024-03-08T21:33:49.342474+0000","last_unstale":"2024-03-08T21:33:50.335721+0000","last_undegraded":"2024-03-08T21:33:50.335721+0000","last_fullsized":"2024-03-08T21:33:50.335721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328615+0000","last_change":"2024-03-08T21:33:49.344117+0000","last_active":"2024-03-08T21:33:50.328615+0000","last_peered":"2024-03-08T21:33:50.328615+0000","last_clean":"2024-03-08T21:33:50.328615+0000","last_became_active":"2024-03-08T21:33:49.343840+0000","last_became_peered":"2024-03-08T21:33:49.343840+0000","last_unstale":"2024-03-08T21:33:50.328615+0000","last_undegraded":"2024-03-08T21:33:50.328615+0000","last_fullsized":"2024-03-08T21:33:50.328615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661224+0000","last_change":"2024-03-08T21:33:49.338130+0000","last_active":"2024-03-08T21:33:50.661224+0000","last_peered":"2024-03-08T21:33:50.661224+0000","last_clean":"2024-03-08T21:33:50.661224+0000","last_became_active":"2024-03-08T21:33:49.337923+0000","last_became_peered":"2024-03-08T21:33:49.337923+0000","last_unstale":"2024-03-08T21:33:50.661224+0000","last_undegraded":"2024-03-08T21:33:50.661224+0000","last_fullsized":"2024-03-08T21:33:50.661224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:22.930884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661619+0000","last_change":"2024-03-08T21:33:49.338988+0000","last_active":"2024-03-08T21:33:50.661619+0000","last_peered":"2024-03-08T21:33:50.661619+0000","last_clean":"2024-03-08T21:33:50.661619+0000","last_became_active":"2024-03-08T21:33:49.338156+0000","last_became_peered":"2024-03-08T21:33:49.338156+0000","last_unstale":"2024-03-08T21:33:50.661619+0000","last_undegraded":"2024-03-08T21:33:50.661619+0000","last_fullsized":"2024-03-08T21:33:50.661619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:51:19.989495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660829+0000","last_change":"2024-03-08T21:33:49.345748+0000","last_active":"2024-03-08T21:33:50.660829+0000","last_peered":"2024-03-08T21:33:50.660829+0000","last_clean":"2024-03-08T21:33:50.660829+0000","last_became_active":"2024-03-08T21:33:49.345428+0000","last_became_peered":"2024-03-08T21:33:49.345428+0000","last_unstale":"2024-03-08T21:33:50.660829+0000","last_undegraded":"2024-03-08T21:33:50.660829+0000","last_fullsized":"2024-03-08T21:33:50.660829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:31:33.742418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328975+0000","last_change":"2024-03-08T21:33:49.338873+0000","last_active":"2024-03-08T21:33:50.328975+0000","last_peered":"2024-03-08T21:33:50.328975+0000","last_clean":"2024-03-08T21:33:50.328975+0000","last_became_active":"2024-03-08T21:33:49.338055+0000","last_became_peered":"2024-03-08T21:33:49.338055+0000","last_unstale":"2024-03-08T21:33:50.328975+0000","last_undegraded":"2024-03-08T21:33:50.328975+0000","last_fullsized":"2024-03-08T21:33:50.328975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:25:09.396337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335228+0000","last_change":"2024-03-08T21:33:49.326802+0000","last_active":"2024-03-08T21:33:50.335228+0000","last_peered":"2024-03-08T21:33:50.335228+0000","last_clean":"2024-03-08T21:33:50.335228+0000","last_became_active":"2024-03-08T21:33:49.326507+0000","last_became_peered":"2024-03-08T21:33:49.326507+0000","last_unstale":"2024-03-08T21:33:50.335228+0000","last_undegraded":"2024-03-08T21:33:50.335228+0000","last_fullsized":"2024-03-08T21:33:50.335228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:20:42.018891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328323+0000","last_change":"2024-03-08T21:33:49.332694+0000","last_active":"2024-03-08T21:33:50.328323+0000","last_peered":"2024-03-08T21:33:50.328323+0000","last_clean":"2024-03-08T21:33:50.328323+0000","last_became_active":"2024-03-08T21:33:49.332330+0000","last_became_peered":"2024-03-08T21:33:49.332330+0000","last_unstale":"2024-03-08T21:33:50.328323+0000","last_undegraded":"2024-03-08T21:33:50.328323+0000","last_fullsized":"2024-03-08T21:33:50.328323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:39.246275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660986+0000","last_change":"2024-03-08T21:33:48.318511+0000","last_active":"2024-03-08T21:33:50.660986+0000","last_peered":"2024-03-08T21:33:50.660986+0000","last_clean":"2024-03-08T21:33:50.660986+0000","last_became_active":"2024-03-08T21:33:48.318248+0000","last_became_peered":"2024-03-08T21:33:48.318248+0000","last_unstale":"2024-03-08T21:33:50.660986+0000","last_undegraded":"2024-03-08T21:33:50.660986+0000","last_fullsized":"2024-03-08T21:33:50.660986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:41.855784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661740+0000","last_change":"2024-03-08T21:33:49.336639+0000","last_active":"2024-03-08T21:33:50.661740+0000","last_peered":"2024-03-08T21:33:50.661740+0000","last_clean":"2024-03-08T21:33:50.661740+0000","last_became_active":"2024-03-08T21:33:49.336391+0000","last_became_peered":"2024-03-08T21:33:49.336391+0000","last_unstale":"2024-03-08T21:33:50.661740+0000","last_undegraded":"2024-03-08T21:33:50.661740+0000","last_fullsized":"2024-03-08T21:33:50.661740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:10:14.440484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335233+0000","last_change":"2024-03-08T21:33:48.319438+0000","last_active":"2024-03-08T21:33:50.335233+0000","last_peered":"2024-03-08T21:33:50.335233+0000","last_clean":"2024-03-08T21:33:50.335233+0000","last_became_active":"2024-03-08T21:33:48.319140+0000","last_became_peered":"2024-03-08T21:33:48.319140+0000","last_unstale":"2024-03-08T21:33:50.335233+0000","last_undegraded":"2024-03-08T21:33:50.335233+0000","last_fullsized":"2024-03-08T21:33:50.335233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660609+0000","last_change":"2024-03-08T21:33:48.320554+0000","last_active":"2024-03-08T21:33:50.660609+0000","last_peered":"2024-03-08T21:33:50.660609+0000","last_clean":"2024-03-08T21:33:50.660609+0000","last_became_active":"2024-03-08T21:33:48.320236+0000","last_became_peered":"2024-03-08T21:33:48.320236+0000","last_unstale":"2024-03-08T21:33:50.660609+0000","last_undegraded":"2024-03-08T21:33:50.660609+0000","last_fullsized":"2024-03-08T21:33:50.660609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:51:54.872396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660569+0000","last_change":"2024-03-08T21:33:49.329537+0000","last_active":"2024-03-08T21:33:50.660569+0000","last_peered":"2024-03-08T21:33:50.660569+0000","last_clean":"2024-03-08T21:33:50.660569+0000","last_became_active":"2024-03-08T21:33:49.329235+0000","last_became_peered":"2024-03-08T21:33:49.329235+0000","last_unstale":"2024-03-08T21:33:50.660569+0000","last_undegraded":"2024-03-08T21:33:50.660569+0000","last_fullsized":"2024-03-08T21:33:50.660569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660569+0000","last_change":"2024-03-08T21:33:48.320328+0000","last_active":"2024-03-08T21:33:50.660569+0000","last_peered":"2024-03-08T21:33:50.660569+0000","last_clean":"2024-03-08T21:33:50.660569+0000","last_became_active":"2024-03-08T21:33:48.319881+0000","last_became_peered":"2024-03-08T21:33:48.319881+0000","last_unstale":"2024-03-08T21:33:50.660569+0000","last_undegraded":"2024-03-08T21:33:50.660569+0000","last_fullsized":"2024-03-08T21:33:50.660569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.344229+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.343942+0000","last_became_peered":"2024-03-08T21:33:49.343942+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335604+0000","last_change":"2024-03-08T21:33:48.331439+0000","last_active":"2024-03-08T21:33:50.335604+0000","last_peered":"2024-03-08T21:33:50.335604+0000","last_clean":"2024-03-08T21:33:50.335604+0000","last_became_active":"2024-03-08T21:33:48.331088+0000","last_became_peered":"2024-03-08T21:33:48.331088+0000","last_unstale":"2024-03-08T21:33:50.335604+0000","last_undegraded":"2024-03-08T21:33:50.335604+0000","last_fullsized":"2024-03-08T21:33:50.335604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661299+0000","last_change":"2024-03-08T21:33:49.345091+0000","last_active":"2024-03-08T21:33:50.661299+0000","last_peered":"2024-03-08T21:33:50.661299+0000","last_clean":"2024-03-08T21:33:50.661299+0000","last_became_active":"2024-03-08T21:33:49.344796+0000","last_became_peered":"2024-03-08T21:33:49.344796+0000","last_unstale":"2024-03-08T21:33:50.661299+0000","last_undegraded":"2024-03-08T21:33:50.661299+0000","last_fullsized":"2024-03-08T21:33:50.661299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:37:11.752417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661404+0000","last_change":"2024-03-08T21:33:48.336669+0000","last_active":"2024-03-08T21:33:50.661404+0000","last_peered":"2024-03-08T21:33:50.661404+0000","last_clean":"2024-03-08T21:33:50.661404+0000","last_became_active":"2024-03-08T21:33:48.336403+0000","last_became_peered":"2024-03-08T21:33:48.336403+0000","last_unstale":"2024-03-08T21:33:50.661404+0000","last_undegraded":"2024-03-08T21:33:50.661404+0000","last_fullsized":"2024-03-08T21:33:50.661404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661769+0000","last_change":"2024-03-08T21:33:49.339581+0000","last_active":"2024-03-08T21:33:50.661769+0000","last_peered":"2024-03-08T21:33:50.661769+0000","last_clean":"2024-03-08T21:33:50.661769+0000","last_became_active":"2024-03-08T21:33:49.332498+0000","last_became_peered":"2024-03-08T21:33:49.332498+0000","last_unstale":"2024-03-08T21:33:50.661769+0000","last_undegraded":"2024-03-08T21:33:50.661769+0000","last_fullsized":"2024-03-08T21:33:50.661769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:42:15.247987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328697+0000","last_change":"2024-03-08T21:33:48.326093+0000","last_active":"2024-03-08T21:33:50.328697+0000","last_peered":"2024-03-08T21:33:50.328697+0000","last_clean":"2024-03-08T21:33:50.328697+0000","last_became_active":"2024-03-08T21:33:48.325836+0000","last_became_peered":"2024-03-08T21:33:48.325836+0000","last_unstale":"2024-03-08T21:33:50.328697+0000","last_undegraded":"2024-03-08T21:33:50.328697+0000","last_fullsized":"2024-03-08T21:33:50.328697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328698+0000","last_change":"2024-03-08T21:33:49.321155+0000","last_active":"2024-03-08T21:33:50.328698+0000","last_peered":"2024-03-08T21:33:50.328698+0000","last_clean":"2024-03-08T21:33:50.328698+0000","last_became_active":"2024-03-08T21:33:49.320883+0000","last_became_peered":"2024-03-08T21:33:49.320883+0000","last_unstale":"2024-03-08T21:33:50.328698+0000","last_undegraded":"2024-03-08T21:33:50.328698+0000","last_fullsized":"2024-03-08T21:33:50.328698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:45:58.416650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335352+0000","last_change":"2024-03-08T21:33:48.311111+0000","last_active":"2024-03-08T21:33:50.335352+0000","last_peered":"2024-03-08T21:33:50.335352+0000","last_clean":"2024-03-08T21:33:50.335352+0000","last_became_active":"2024-03-08T21:33:48.310608+0000","last_became_peered":"2024-03-08T21:33:48.310608+0000","last_unstale":"2024-03-08T21:33:50.335352+0000","last_undegraded":"2024-03-08T21:33:50.335352+0000","last_fullsized":"2024-03-08T21:33:50.335352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661651+0000","last_change":"2024-03-08T21:33:49.334300+0000","last_active":"2024-03-08T21:33:50.661651+0000","last_peered":"2024-03-08T21:33:50.661651+0000","last_clean":"2024-03-08T21:33:50.661651+0000","last_became_active":"2024-03-08T21:33:49.333906+0000","last_became_peered":"2024-03-08T21:33:49.333906+0000","last_unstale":"2024-03-08T21:33:50.661651+0000","last_undegraded":"2024-03-08T21:33:50.661651+0000","last_fullsized":"2024-03-08T21:33:50.661651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:32:27.626987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661723+0000","last_change":"2024-03-08T21:33:48.316480+0000","last_active":"2024-03-08T21:33:50.661723+0000","last_peered":"2024-03-08T21:33:50.661723+0000","last_clean":"2024-03-08T21:33:50.661723+0000","last_became_active":"2024-03-08T21:33:48.316135+0000","last_became_peered":"2024-03-08T21:33:48.316135+0000","last_unstale":"2024-03-08T21:33:50.661723+0000","last_undegraded":"2024-03-08T21:33:50.661723+0000","last_fullsized":"2024-03-08T21:33:50.661723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:24:09.644526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661507+0000","last_change":"2024-03-08T21:33:49.324801+0000","last_active":"2024-03-08T21:33:50.661507+0000","last_peered":"2024-03-08T21:33:50.661507+0000","last_clean":"2024-03-08T21:33:50.661507+0000","last_became_active":"2024-03-08T21:33:49.324523+0000","last_became_peered":"2024-03-08T21:33:49.324523+0000","last_unstale":"2024-03-08T21:33:50.661507+0000","last_undegraded":"2024-03-08T21:33:50.661507+0000","last_fullsized":"2024-03-08T21:33:50.661507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:36:35.145970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660829+0000","last_change":"2024-03-08T21:33:48.324724+0000","last_active":"2024-03-08T21:33:50.660829+0000","last_peered":"2024-03-08T21:33:50.660829+0000","last_clean":"2024-03-08T21:33:50.660829+0000","last_became_active":"2024-03-08T21:33:48.324379+0000","last_became_peered":"2024-03-08T21:33:48.324379+0000","last_unstale":"2024-03-08T21:33:50.660829+0000","last_undegraded":"2024-03-08T21:33:50.660829+0000","last_fullsized":"2024-03-08T21:33:50.660829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661599+0000","last_change":"2024-03-08T21:33:49.331839+0000","last_active":"2024-03-08T21:33:50.661599+0000","last_peered":"2024-03-08T21:33:50.661599+0000","last_clean":"2024-03-08T21:33:50.661599+0000","last_became_active":"2024-03-08T21:33:49.329912+0000","last_became_peered":"2024-03-08T21:33:49.329912+0000","last_unstale":"2024-03-08T21:33:50.661599+0000","last_undegraded":"2024-03-08T21:33:50.661599+0000","last_fullsized":"2024-03-08T21:33:50.661599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335165+0000","last_change":"2024-03-08T21:33:48.311849+0000","last_active":"2024-03-08T21:33:50.335165+0000","last_peered":"2024-03-08T21:33:50.335165+0000","last_clean":"2024-03-08T21:33:50.335165+0000","last_became_active":"2024-03-08T21:33:48.310917+0000","last_became_peered":"2024-03-08T21:33:48.310917+0000","last_unstale":"2024-03-08T21:33:50.335165+0000","last_undegraded":"2024-03-08T21:33:50.335165+0000","last_fullsized":"2024-03-08T21:33:50.335165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335308+0000","last_change":"2024-03-08T21:33:49.326937+0000","last_active":"2024-03-08T21:33:50.335308+0000","last_peered":"2024-03-08T21:33:50.335308+0000","last_clean":"2024-03-08T21:33:50.335308+0000","last_became_active":"2024-03-08T21:33:49.326518+0000","last_became_peered":"2024-03-08T21:33:49.326518+0000","last_unstale":"2024-03-08T21:33:50.335308+0000","last_undegraded":"2024-03-08T21:33:50.335308+0000","last_fullsized":"2024-03-08T21:33:50.335308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328078+0000","last_change":"2024-03-08T21:33:48.318497+0000","last_active":"2024-03-08T21:33:50.328078+0000","last_peered":"2024-03-08T21:33:50.328078+0000","last_clean":"2024-03-08T21:33:50.328078+0000","last_became_active":"2024-03-08T21:33:48.317867+0000","last_became_peered":"2024-03-08T21:33:48.317867+0000","last_unstale":"2024-03-08T21:33:50.328078+0000","last_undegraded":"2024-03-08T21:33:50.328078+0000","last_fullsized":"2024-03-08T21:33:50.328078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661213+0000","last_change":"2024-03-08T21:33:49.329322+0000","last_active":"2024-03-08T21:33:50.661213+0000","last_peered":"2024-03-08T21:33:50.661213+0000","last_clean":"2024-03-08T21:33:50.661213+0000","last_became_active":"2024-03-08T21:33:49.328970+0000","last_became_peered":"2024-03-08T21:33:49.328970+0000","last_unstale":"2024-03-08T21:33:50.661213+0000","last_undegraded":"2024-03-08T21:33:50.661213+0000","last_fullsized":"2024-03-08T21:33:50.661213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:45:58.832650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329040+0000","last_change":"2024-03-08T21:33:48.313918+0000","last_active":"2024-03-08T21:33:50.329040+0000","last_peered":"2024-03-08T21:33:50.329040+0000","last_clean":"2024-03-08T21:33:50.329040+0000","last_became_active":"2024-03-08T21:33:48.313623+0000","last_became_peered":"2024-03-08T21:33:48.313623+0000","last_unstale":"2024-03-08T21:33:50.329040+0000","last_undegraded":"2024-03-08T21:33:50.329040+0000","last_fullsized":"2024-03-08T21:33:50.329040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:12:02.322314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661706+0000","last_change":"2024-03-08T21:33:49.337361+0000","last_active":"2024-03-08T21:33:50.661706+0000","last_peered":"2024-03-08T21:33:50.661706+0000","last_clean":"2024-03-08T21:33:50.661706+0000","last_became_active":"2024-03-08T21:33:49.337028+0000","last_became_peered":"2024-03-08T21:33:49.337028+0000","last_unstale":"2024-03-08T21:33:50.661706+0000","last_undegraded":"2024-03-08T21:33:50.661706+0000","last_fullsized":"2024-03-08T21:33:50.661706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:15:41.039978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.329029+0000","last_change":"2024-03-08T21:33:48.310802+0000","last_active":"2024-03-08T21:33:50.329029+0000","last_peered":"2024-03-08T21:33:50.329029+0000","last_clean":"2024-03-08T21:33:50.329029+0000","last_became_active":"2024-03-08T21:33:48.310508+0000","last_became_peered":"2024-03-08T21:33:48.310508+0000","last_unstale":"2024-03-08T21:33:50.329029+0000","last_undegraded":"2024-03-08T21:33:50.329029+0000","last_fullsized":"2024-03-08T21:33:50.329029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662228+0000","last_change":"2024-03-08T21:33:49.337562+0000","last_active":"2024-03-08T21:33:50.662228+0000","last_peered":"2024-03-08T21:33:50.662228+0000","last_clean":"2024-03-08T21:33:50.662228+0000","last_became_active":"2024-03-08T21:33:49.337051+0000","last_became_peered":"2024-03-08T21:33:49.337051+0000","last_unstale":"2024-03-08T21:33:50.662228+0000","last_undegraded":"2024-03-08T21:33:50.662228+0000","last_fullsized":"2024-03-08T21:33:50.662228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:55:19.344690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328788+0000","last_change":"2024-03-08T21:33:48.319889+0000","last_active":"2024-03-08T21:33:50.328788+0000","last_peered":"2024-03-08T21:33:50.328788+0000","last_clean":"2024-03-08T21:33:50.328788+0000","last_became_active":"2024-03-08T21:33:48.319630+0000","last_became_peered":"2024-03-08T21:33:48.319630+0000","last_unstale":"2024-03-08T21:33:50.328788+0000","last_undegraded":"2024-03-08T21:33:50.328788+0000","last_fullsized":"2024-03-08T21:33:50.328788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661307+0000","last_change":"2024-03-08T21:33:49.345172+0000","last_active":"2024-03-08T21:33:50.661307+0000","last_peered":"2024-03-08T21:33:50.661307+0000","last_clean":"2024-03-08T21:33:50.661307+0000","last_became_active":"2024-03-08T21:33:49.344744+0000","last_became_peered":"2024-03-08T21:33:49.344744+0000","last_unstale":"2024-03-08T21:33:50.661307+0000","last_undegraded":"2024-03-08T21:33:50.661307+0000","last_fullsized":"2024-03-08T21:33:50.661307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:11:13.810022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328849+0000","last_change":"2024-03-08T21:33:48.324914+0000","last_active":"2024-03-08T21:33:50.328849+0000","last_peered":"2024-03-08T21:33:50.328849+0000","last_clean":"2024-03-08T21:33:50.328849+0000","last_became_active":"2024-03-08T21:33:48.324729+0000","last_became_peered":"2024-03-08T21:33:48.324729+0000","last_unstale":"2024-03-08T21:33:50.328849+0000","last_undegraded":"2024-03-08T21:33:50.328849+0000","last_fullsized":"2024-03-08T21:33:50.328849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661742+0000","last_change":"2024-03-08T21:33:49.343068+0000","last_active":"2024-03-08T21:33:50.661742+0000","last_peered":"2024-03-08T21:33:50.661742+0000","last_clean":"2024-03-08T21:33:50.661742+0000","last_became_active":"2024-03-08T21:33:49.342769+0000","last_became_peered":"2024-03-08T21:33:49.342769+0000","last_unstale":"2024-03-08T21:33:50.661742+0000","last_undegraded":"2024-03-08T21:33:50.661742+0000","last_fullsized":"2024-03-08T21:33:50.661742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.091680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660559+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:33:50.660559+0000","last_peered":"2024-03-08T21:33:50.660559+0000","last_clean":"2024-03-08T21:33:50.660559+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:33:50.660559+0000","last_undegraded":"2024-03-08T21:33:50.660559+0000","last_fullsized":"2024-03-08T21:33:50.660559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660771+0000","last_change":"2024-03-08T21:33:48.322277+0000","last_active":"2024-03-08T21:33:50.660771+0000","last_peered":"2024-03-08T21:33:50.660771+0000","last_clean":"2024-03-08T21:33:50.660771+0000","last_became_active":"2024-03-08T21:33:48.321924+0000","last_became_peered":"2024-03-08T21:33:48.321924+0000","last_unstale":"2024-03-08T21:33:50.660771+0000","last_undegraded":"2024-03-08T21:33:50.660771+0000","last_fullsized":"2024-03-08T21:33:50.660771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660803+0000","last_change":"2024-03-08T21:33:49.336954+0000","last_active":"2024-03-08T21:33:50.660803+0000","last_peered":"2024-03-08T21:33:50.660803+0000","last_clean":"2024-03-08T21:33:50.660803+0000","last_became_active":"2024-03-08T21:33:49.336698+0000","last_became_peered":"2024-03-08T21:33:49.336698+0000","last_unstale":"2024-03-08T21:33:50.660803+0000","last_undegraded":"2024-03-08T21:33:50.660803+0000","last_fullsized":"2024-03-08T21:33:50.660803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:40:48.306014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660474+0000","last_change":"2024-03-08T21:33:48.324162+0000","last_active":"2024-03-08T21:33:50.660474+0000","last_peered":"2024-03-08T21:33:50.660474+0000","last_clean":"2024-03-08T21:33:50.660474+0000","last_became_active":"2024-03-08T21:33:48.323370+0000","last_became_peered":"2024-03-08T21:33:48.323370+0000","last_unstale":"2024-03-08T21:33:50.660474+0000","last_undegraded":"2024-03-08T21:33:50.660474+0000","last_fullsized":"2024-03-08T21:33:50.660474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661478+0000","last_change":"2024-03-08T21:33:49.335670+0000","last_active":"2024-03-08T21:33:50.661478+0000","last_peered":"2024-03-08T21:33:50.661478+0000","last_clean":"2024-03-08T21:33:50.661478+0000","last_became_active":"2024-03-08T21:33:49.335420+0000","last_became_peered":"2024-03-08T21:33:49.335420+0000","last_unstale":"2024-03-08T21:33:50.661478+0000","last_undegraded":"2024-03-08T21:33:50.661478+0000","last_fullsized":"2024-03-08T21:33:50.661478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:07:55.296028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328196+0000","last_change":"2024-03-08T21:33:48.304590+0000","last_active":"2024-03-08T21:33:50.328196+0000","last_peered":"2024-03-08T21:33:50.328196+0000","last_clean":"2024-03-08T21:33:50.328196+0000","last_became_active":"2024-03-08T21:33:48.304130+0000","last_became_peered":"2024-03-08T21:33:48.304130+0000","last_unstale":"2024-03-08T21:33:50.328196+0000","last_undegraded":"2024-03-08T21:33:50.328196+0000","last_fullsized":"2024-03-08T21:33:50.328196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.327956+0000","last_change":"2024-03-08T21:33:49.339223+0000","last_active":"2024-03-08T21:33:50.327956+0000","last_peered":"2024-03-08T21:33:50.327956+0000","last_clean":"2024-03-08T21:33:50.327956+0000","last_became_active":"2024-03-08T21:33:49.338871+0000","last_became_peered":"2024-03-08T21:33:49.338871+0000","last_unstale":"2024-03-08T21:33:50.327956+0000","last_undegraded":"2024-03-08T21:33:50.327956+0000","last_fullsized":"2024-03-08T21:33:50.327956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:49:51.202672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660985+0000","last_change":"2024-03-08T21:33:48.322438+0000","last_active":"2024-03-08T21:33:50.660985+0000","last_peered":"2024-03-08T21:33:50.660985+0000","last_clean":"2024-03-08T21:33:50.660985+0000","last_became_active":"2024-03-08T21:33:48.322161+0000","last_became_peered":"2024-03-08T21:33:48.322161+0000","last_unstale":"2024-03-08T21:33:50.660985+0000","last_undegraded":"2024-03-08T21:33:50.660985+0000","last_fullsized":"2024-03-08T21:33:50.660985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:33.542171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328805+0000","last_change":"2024-03-08T21:33:49.323865+0000","last_active":"2024-03-08T21:33:50.328805+0000","last_peered":"2024-03-08T21:33:50.328805+0000","last_clean":"2024-03-08T21:33:50.328805+0000","last_became_active":"2024-03-08T21:33:49.323330+0000","last_became_peered":"2024-03-08T21:33:49.323330+0000","last_unstale":"2024-03-08T21:33:50.328805+0000","last_undegraded":"2024-03-08T21:33:50.328805+0000","last_fullsized":"2024-03-08T21:33:50.328805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:52:43.691318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328384+0000","last_change":"2024-03-08T21:33:48.317519+0000","last_active":"2024-03-08T21:33:50.328384+0000","last_peered":"2024-03-08T21:33:50.328384+0000","last_clean":"2024-03-08T21:33:50.328384+0000","last_became_active":"2024-03-08T21:33:48.317260+0000","last_became_peered":"2024-03-08T21:33:48.317260+0000","last_unstale":"2024-03-08T21:33:50.328384+0000","last_undegraded":"2024-03-08T21:33:50.328384+0000","last_fullsized":"2024-03-08T21:33:50.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661171+0000","last_change":"2024-03-08T21:33:49.343487+0000","last_active":"2024-03-08T21:33:50.661171+0000","last_peered":"2024-03-08T21:33:50.661171+0000","last_clean":"2024-03-08T21:33:50.661171+0000","last_became_active":"2024-03-08T21:33:49.343231+0000","last_became_peered":"2024-03-08T21:33:49.343231+0000","last_unstale":"2024-03-08T21:33:50.661171+0000","last_undegraded":"2024-03-08T21:33:50.661171+0000","last_fullsized":"2024-03-08T21:33:50.661171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:26:59.091680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.662057+0000","last_change":"2024-03-08T21:33:48.320355+0000","last_active":"2024-03-08T21:33:50.662057+0000","last_peered":"2024-03-08T21:33:50.662057+0000","last_clean":"2024-03-08T21:33:50.662057+0000","last_became_active":"2024-03-08T21:33:48.320045+0000","last_became_peered":"2024-03-08T21:33:48.320045+0000","last_unstale":"2024-03-08T21:33:50.662057+0000","last_undegraded":"2024-03-08T21:33:50.662057+0000","last_fullsized":"2024-03-08T21:33:50.662057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328590+0000","last_change":"2024-03-08T21:33:49.335152+0000","last_active":"2024-03-08T21:33:50.328590+0000","last_peered":"2024-03-08T21:33:50.328590+0000","last_clean":"2024-03-08T21:33:50.328590+0000","last_became_active":"2024-03-08T21:33:49.334899+0000","last_became_peered":"2024-03-08T21:33:49.334899+0000","last_unstale":"2024-03-08T21:33:50.328590+0000","last_undegraded":"2024-03-08T21:33:50.328590+0000","last_fullsized":"2024-03-08T21:33:50.328590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.334653+0000","last_change":"2024-03-08T21:33:48.321898+0000","last_active":"2024-03-08T21:33:50.334653+0000","last_peered":"2024-03-08T21:33:50.334653+0000","last_clean":"2024-03-08T21:33:50.334653+0000","last_became_active":"2024-03-08T21:33:48.321538+0000","last_became_peered":"2024-03-08T21:33:48.321538+0000","last_unstale":"2024-03-08T21:33:50.334653+0000","last_undegraded":"2024-03-08T21:33:50.334653+0000","last_fullsized":"2024-03-08T21:33:50.334653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661266+0000","last_change":"2024-03-08T21:33:49.329726+0000","last_active":"2024-03-08T21:33:50.661266+0000","last_peered":"2024-03-08T21:33:50.661266+0000","last_clean":"2024-03-08T21:33:50.661266+0000","last_became_active":"2024-03-08T21:33:49.329391+0000","last_became_peered":"2024-03-08T21:33:49.329391+0000","last_unstale":"2024-03-08T21:33:50.661266+0000","last_undegraded":"2024-03-08T21:33:50.661266+0000","last_fullsized":"2024-03-08T21:33:50.661266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:32.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335670+0000","last_change":"2024-03-08T21:33:48.321998+0000","last_active":"2024-03-08T21:33:50.335670+0000","last_peered":"2024-03-08T21:33:50.335670+0000","last_clean":"2024-03-08T21:33:50.335670+0000","last_became_active":"2024-03-08T21:33:48.321277+0000","last_became_peered":"2024-03-08T21:33:48.321277+0000","last_unstale":"2024-03-08T21:33:50.335670+0000","last_undegraded":"2024-03-08T21:33:50.335670+0000","last_fullsized":"2024-03-08T21:33:50.335670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:44:44.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661893+0000","last_change":"2024-03-08T21:33:49.340131+0000","last_active":"2024-03-08T21:33:50.661893+0000","last_peered":"2024-03-08T21:33:50.661893+0000","last_clean":"2024-03-08T21:33:50.661893+0000","last_became_active":"2024-03-08T21:33:49.339816+0000","last_became_peered":"2024-03-08T21:33:49.339816+0000","last_unstale":"2024-03-08T21:33:50.661893+0000","last_undegraded":"2024-03-08T21:33:50.661893+0000","last_fullsized":"2024-03-08T21:33:50.661893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:33.225083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660432+0000","last_change":"2024-03-08T21:33:48.316829+0000","last_active":"2024-03-08T21:33:50.660432+0000","last_peered":"2024-03-08T21:33:50.660432+0000","last_clean":"2024-03-08T21:33:50.660432+0000","last_became_active":"2024-03-08T21:33:48.316647+0000","last_became_peered":"2024-03-08T21:33:48.316647+0000","last_unstale":"2024-03-08T21:33:50.660432+0000","last_undegraded":"2024-03-08T21:33:50.660432+0000","last_fullsized":"2024-03-08T21:33:50.660432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328708+0000","last_change":"2024-03-08T21:33:49.335879+0000","last_active":"2024-03-08T21:33:50.328708+0000","last_peered":"2024-03-08T21:33:50.328708+0000","last_clean":"2024-03-08T21:33:50.328708+0000","last_became_active":"2024-03-08T21:33:49.335555+0000","last_became_peered":"2024-03-08T21:33:49.335555+0000","last_unstale":"2024-03-08T21:33:50.328708+0000","last_undegraded":"2024-03-08T21:33:50.328708+0000","last_fullsized":"2024-03-08T21:33:50.328708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:05:04.726067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328130+0000","last_change":"2024-03-08T21:33:48.319210+0000","last_active":"2024-03-08T21:33:50.328130+0000","last_peered":"2024-03-08T21:33:50.328130+0000","last_clean":"2024-03-08T21:33:50.328130+0000","last_became_active":"2024-03-08T21:33:48.318910+0000","last_became_peered":"2024-03-08T21:33:48.318910+0000","last_unstale":"2024-03-08T21:33:50.328130+0000","last_undegraded":"2024-03-08T21:33:50.328130+0000","last_fullsized":"2024-03-08T21:33:50.328130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:00:18.446001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660686+0000","last_change":"2024-03-08T21:33:49.336542+0000","last_active":"2024-03-08T21:33:50.660686+0000","last_peered":"2024-03-08T21:33:50.660686+0000","last_clean":"2024-03-08T21:33:50.660686+0000","last_became_active":"2024-03-08T21:33:49.336243+0000","last_became_peered":"2024-03-08T21:33:49.336243+0000","last_unstale":"2024-03-08T21:33:50.660686+0000","last_undegraded":"2024-03-08T21:33:50.660686+0000","last_fullsized":"2024-03-08T21:33:50.660686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:35:35.591251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.328488+0000","last_change":"2024-03-08T21:33:48.309925+0000","last_active":"2024-03-08T21:33:50.328488+0000","last_peered":"2024-03-08T21:33:50.328488+0000","last_clean":"2024-03-08T21:33:50.328488+0000","last_became_active":"2024-03-08T21:33:48.309536+0000","last_became_peered":"2024-03-08T21:33:48.309536+0000","last_unstale":"2024-03-08T21:33:50.328488+0000","last_undegraded":"2024-03-08T21:33:50.328488+0000","last_fullsized":"2024-03-08T21:33:50.328488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:54.986151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660752+0000","last_change":"2024-03-08T21:33:49.330871+0000","last_active":"2024-03-08T21:33:50.660752+0000","last_peered":"2024-03-08T21:33:50.660752+0000","last_clean":"2024-03-08T21:33:50.660752+0000","last_became_active":"2024-03-08T21:33:49.330561+0000","last_became_peered":"2024-03-08T21:33:49.330561+0000","last_unstale":"2024-03-08T21:33:50.660752+0000","last_undegraded":"2024-03-08T21:33:50.660752+0000","last_fullsized":"2024-03-08T21:33:50.660752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:23:06.083214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661709+0000","last_change":"2024-03-08T21:33:48.326317+0000","last_active":"2024-03-08T21:33:50.661709+0000","last_peered":"2024-03-08T21:33:50.661709+0000","last_clean":"2024-03-08T21:33:50.661709+0000","last_became_active":"2024-03-08T21:33:48.325057+0000","last_became_peered":"2024-03-08T21:33:48.325057+0000","last_unstale":"2024-03-08T21:33:50.661709+0000","last_undegraded":"2024-03-08T21:33:50.661709+0000","last_fullsized":"2024-03-08T21:33:50.661709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:23:09.178755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.335298+0000","last_change":"2024-03-08T21:33:49.332013+0000","last_active":"2024-03-08T21:33:50.335298+0000","last_peered":"2024-03-08T21:33:50.335298+0000","last_clean":"2024-03-08T21:33:50.335298+0000","last_became_active":"2024-03-08T21:33:49.331755+0000","last_became_peered":"2024-03-08T21:33:49.331755+0000","last_unstale":"2024-03-08T21:33:50.335298+0000","last_undegraded":"2024-03-08T21:33:50.335298+0000","last_fullsized":"2024-03-08T21:33:50.335298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:22:43.728762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661096+0000","last_change":"2024-03-08T21:33:49.339645+0000","last_active":"2024-03-08T21:33:50.661096+0000","last_peered":"2024-03-08T21:33:50.661096+0000","last_clean":"2024-03-08T21:33:50.661096+0000","last_became_active":"2024-03-08T21:33:49.339017+0000","last_became_peered":"2024-03-08T21:33:49.339017+0000","last_unstale":"2024-03-08T21:33:50.661096+0000","last_undegraded":"2024-03-08T21:33:50.661096+0000","last_fullsized":"2024-03-08T21:33:50.661096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:15:41.039978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661446+0000","last_change":"2024-03-08T21:33:48.328103+0000","last_active":"2024-03-08T21:33:50.661446+0000","last_peered":"2024-03-08T21:33:50.661446+0000","last_clean":"2024-03-08T21:33:50.661446+0000","last_became_active":"2024-03-08T21:33:48.327722+0000","last_became_peered":"2024-03-08T21:33:48.327722+0000","last_unstale":"2024-03-08T21:33:50.661446+0000","last_undegraded":"2024-03-08T21:33:50.661446+0000","last_fullsized":"2024-03-08T21:33:50.661446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:21:07.984837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.660999+0000","last_change":"2024-03-08T21:33:49.350219+0000","last_active":"2024-03-08T21:33:50.660999+0000","last_peered":"2024-03-08T21:33:50.660999+0000","last_clean":"2024-03-08T21:33:50.660999+0000","last_became_active":"2024-03-08T21:33:49.349972+0000","last_became_peered":"2024-03-08T21:33:49.349972+0000","last_unstale":"2024-03-08T21:33:50.660999+0000","last_undegraded":"2024-03-08T21:33:50.660999+0000","last_fullsized":"2024-03-08T21:33:50.660999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:32:27.626987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661865+0000","last_change":"2024-03-08T21:33:48.325856+0000","last_active":"2024-03-08T21:33:50.661865+0000","last_peered":"2024-03-08T21:33:50.661865+0000","last_clean":"2024-03-08T21:33:50.661865+0000","last_became_active":"2024-03-08T21:33:48.325490+0000","last_became_peered":"2024-03-08T21:33:48.325490+0000","last_unstale":"2024-03-08T21:33:50.661865+0000","last_undegraded":"2024-03-08T21:33:50.661865+0000","last_fullsized":"2024-03-08T21:33:50.661865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:35:34.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661684+0000","last_change":"2024-03-08T21:33:49.334099+0000","last_active":"2024-03-08T21:33:50.661684+0000","last_peered":"2024-03-08T21:33:50.661684+0000","last_clean":"2024-03-08T21:33:50.661684+0000","last_became_active":"2024-03-08T21:33:49.332877+0000","last_became_peered":"2024-03-08T21:33:49.332877+0000","last_unstale":"2024-03-08T21:33:50.661684+0000","last_undegraded":"2024-03-08T21:33:50.661684+0000","last_fullsized":"2024-03-08T21:33:50.661684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:10:30.001559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661182+0000","last_change":"2024-03-08T21:33:48.313081+0000","last_active":"2024-03-08T21:33:50.661182+0000","last_peered":"2024-03-08T21:33:50.661182+0000","last_clean":"2024-03-08T21:33:50.661182+0000","last_became_active":"2024-03-08T21:33:48.312823+0000","last_became_peered":"2024-03-08T21:33:48.312823+0000","last_unstale":"2024-03-08T21:33:50.661182+0000","last_undegraded":"2024-03-08T21:33:50.661182+0000","last_fullsized":"2024-03-08T21:33:50.661182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:17:48.215182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661180+0000","last_change":"2024-03-08T21:33:49.330331+0000","last_active":"2024-03-08T21:33:50.661180+0000","last_peered":"2024-03-08T21:33:50.661180+0000","last_clean":"2024-03-08T21:33:50.661180+0000","last_became_active":"2024-03-08T21:33:49.330088+0000","last_became_peered":"2024-03-08T21:33:49.330088+0000","last_unstale":"2024-03-08T21:33:50.661180+0000","last_undegraded":"2024-03-08T21:33:50.661180+0000","last_fullsized":"2024-03-08T21:33:50.661180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:48.286539+0000","last_clean_scrub_stamp":"2024-03-08T21:33:48.286539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:49:49.354730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T21:33:50.661851+0000","last_change":"2024-03-08T21:33:48.323630+0000","last_active":"2024-03-08T21:33:50.661851+0000","last_peered":"2024-03-08T21:33:50.661851+0000","last_clean":"2024-03-08T21:33:50.661851+0000","last_became_active":"2024-03-08T21:33:48.323342+0000","last_became_peered":"2024-03-08T21:33:48.323342+0000","last_unstale":"2024-03-08T21:33:50.661851+0000","last_undegraded":"2024-03-08T21:33:50.661851+0000","last_fullsized":"2024-03-08T21:33:50.661851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:47.280124+0000","last_clean_scrub_stamp":"2024-03-08T21:33:47.280124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:36:50.973279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:33:58.355 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T21:33:58.355 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-08T21:33:58.355 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-08T21:33:58.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-08T21:33:58.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 Processor -- start 2024-03-08T21:33:58.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 -- start start 2024-03-08T21:33:58.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03400b46e0 0x7f03400b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 0x7f034013b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03401450a0 con 0x7f03400b4ac0 2024-03-08T21:33:58.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034009c410 con 0x7f03400b46e0 2024-03-08T21:33:58.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f0346000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03401456f0 con 0x7f0340144ba0 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03400b46e0 0x7f03400b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f03400b4ac0 0x7f034009db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51040/0 (socket says 172.21.15.119:51040) 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033fe00640 1 -- 172.21.15.119:0/1954309157 learned_addr learned my addr 172.21.15.119:0/1954309157 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 --2- 172.21.15.119:0/1954309157 >> v2:172.21.15.119:3300/0 conn(0x7f03400b46e0 0x7f03400b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44016/0 (socket says 172.21.15.119:44016) 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033ea00640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 0x7f034013b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 -- 172.21.15.119:0/1954309157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 msgr2=0x7f034013b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 0x7f034013b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 -- 172.21.15.119:0/1954309157 >> v1:172.21.15.119:6789/0 conn(0x7f03400b4ac0 legacy=0x7f034009db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033f400640 1 -- 172.21.15.119:0/1954309157 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340145380 con 0x7f03400b46e0 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033ea00640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 0x7f034013b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:58.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.546+0000 7f033e000640 1 -- 172.21.15.119:0/1954309157 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193567736 0 0) 0x7f03401450a0 con 0x7f03400b4ac0 2024-03-08T21:33:58.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f033f400640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03400b46e0 0x7f03400b2eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03280097c0 tx=0x7f032801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ee92365ffece9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f033e000640 1 -- 172.21.15.119:0/1954309157 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03280b0070 con 0x7f03400b46e0 2024-03-08T21:33:58.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f033e000640 1 -- 172.21.15.119:0/1954309157 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03280ab600 con 0x7f03400b46e0 2024-03-08T21:33:58.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f033e000640 1 -- 172.21.15.119:0/1954309157 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03280ab9d0 con 0x7f03400b46e0 2024-03-08T21:33:58.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 -- 172.21.15.119:0/1954309157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03400b46e0 msgr2=0x7f03400b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03400b46e0 0x7f03400b2eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03280097c0 tx=0x7f032801c380 comp rx=0 tx=0).stop 2024-03-08T21:33:58.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 -- 172.21.15.119:0/1954309157 shutdown_connections 2024-03-08T21:33:58.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0340144ba0 0x7f034013b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 --2- 172.21.15.119:0/1954309157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03400b46e0 0x7f03400b2eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 -- 172.21.15.119:0/1954309157 >> 172.21.15.119:0/1954309157 conn(0x7f03400b4fb0 msgr2=0x7f03400b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:58.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 -- 172.21.15.119:0/1954309157 shutdown_connections 2024-03-08T21:33:58.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.550+0000 7f0346000640 1 -- 172.21.15.119:0/1954309157 wait complete. 2024-03-08T21:33:58.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 Processor -- start 2024-03-08T21:33:58.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- start start 2024-03-08T21:33:58.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03400b46e0 0x7f034014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03400b4ac0 0x7f0340146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034013bb10 con 0x7f0340144ba0 2024-03-08T21:33:58.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034013b990 con 0x7f03400b46e0 2024-03-08T21:33:58.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034009e280 con 0x7f03400b4ac0 2024-03-08T21:33:58.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44020/0 (socket says 172.21.15.119:44020) 2024-03-08T21:33:58.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 -- 172.21.15.119:0/4237529022 learned_addr learned my addr 172.21.15.119:0/4237529022 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 -- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03400b4ac0 msgr2=0x7f0340146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03400b4ac0 0x7f0340146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 -- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03400b46e0 msgr2=0x7f034014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03400b46e0 0x7f034014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 -- 172.21.15.119:0/4237529022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034014ded0 con 0x7f0340144ba0 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f033fe00640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f033800c750 tx=0x7f033800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338018070 con 0x7f0340144ba0 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800a640 con 0x7f0340144ba0 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034014f4e0 con 0x7f0340144ba0 2024-03-08T21:33:58.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800ce60 con 0x7f0340144ba0 2024-03-08T21:33:58.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.554+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0340147c70 con 0x7f0340144ba0 2024-03-08T21:33:58.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0340067db0 con 0x7f0340144ba0 2024-03-08T21:33:58.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f033801b070 con 0x7f0340144ba0 2024-03-08T21:33:58.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f0337400640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 0x7f031c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0338084db0 con 0x7f0340144ba0 2024-03-08T21:33:58.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f033f400640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 0x7f031c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.558+0000 7f033f400640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 0x7f031c069b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03280ad000 tx=0x7f0328008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.562+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f034014f4e0 con 0x7f0340144ba0 2024-03-08T21:33:58.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.750+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f034014e410 con 0x7f0340144ba0 2024-03-08T21:33:58.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.750+0000 7f0337400640 1 -- 172.21.15.119:0/4237529022 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0338055ac0 con 0x7f0340144ba0 2024-03-08T21:33:58.737 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:58.737 INFO:teuthology.orchestra.run.smithi119.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 msgr2=0x7f031c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 0x7f031c069b20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f03280ad000 tx=0x7f0328008040 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 msgr2=0x7f03400ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f033800c750 tx=0x7f033800cc10 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 shutdown_connections 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f031c067660 0x7f031c069b20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0340144ba0 0x7f03400ad4d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03400b4ac0 0x7f0340146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 --2- 172.21.15.119:0/4237529022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03400b46e0 0x7f034014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 >> 172.21.15.119:0/4237529022 conn(0x7f03400b4fb0 msgr2=0x7f034009d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:58.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 shutdown_connections 2024-03-08T21:33:58.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.754+0000 7f0346000640 1 -- 172.21.15.119:0/4237529022 wait complete. 2024-03-08T21:33:58.758 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-08T21:33:58.758 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:33:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 Processor -- start 2024-03-08T21:33:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 -- start start 2024-03-08T21:33:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f90e806fc60 0x7f90e80b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81411a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80705c0 con 0x7f90e806cc80 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e8070be0 con 0x7f90e806fc60 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90ee800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81416e0 con 0x7f90e8140d10 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90dea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f90e806fc60 0x7f90e80b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90dea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f90e806fc60 0x7f90e80b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44026/0 (socket says 172.21.15.119:44026) 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90dea00640 1 -- 172.21.15.119:0/3888846943 learned_addr learned my addr 172.21.15.119:0/3888846943 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90e7e00640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90dea00640 1 -- 172.21.15.119:0/3888846943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 msgr2=0x7f90e81411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.906+0000 7f90dea00640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90dea00640 1 -- 172.21.15.119:0/3888846943 >> v1:172.21.15.160:6789/0 conn(0x7f90e806cc80 legacy=0x7f90e8072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90dea00640 1 -- 172.21.15.119:0/3888846943 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e806d060 con 0x7f90e806fc60 2024-03-08T21:33:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90e7e00640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90dea00640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806fc60 0x7f90e80b45c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009870 tx=0x7f90d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9be26675ea0cbb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90e6a00640 1 -- 172.21.15.119:0/3888846943 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00a7070 con 0x7f90e806fc60 2024-03-08T21:33:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90e6a00640 1 -- 172.21.15.119:0/3888846943 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d00b0070 con 0x7f90e806fc60 2024-03-08T21:33:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90e6a00640 1 -- 172.21.15.119:0/3888846943 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00ab890 con 0x7f90e806fc60 2024-03-08T21:33:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 -- 172.21.15.119:0/3888846943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806fc60 msgr2=0x7f90e80b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806fc60 0x7f90e80b45c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009870 tx=0x7f90d001c560 comp rx=0 tx=0).stop 2024-03-08T21:33:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 -- 172.21.15.119:0/3888846943 shutdown_connections 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 --2- 172.21.15.119:0/3888846943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806fc60 0x7f90e80b45c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 -- 172.21.15.119:0/3888846943 >> 172.21.15.119:0/3888846943 conn(0x7f90e80b8820 msgr2=0x7f90e80b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 -- 172.21.15.119:0/3888846943 shutdown_connections 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.910+0000 7f90ee800640 1 -- 172.21.15.119:0/3888846943 wait complete. 2024-03-08T21:33:58.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 Processor -- start 2024-03-08T21:33:58.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- start start 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90e806fc60 0x7f90e8148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81df350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81541e0 con 0x7f90e806cc80 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8154060 con 0x7f90e806fc60 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8154360 con 0x7f90e8140d10 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44028/0 (socket says 172.21.15.119:44028) 2024-03-08T21:33:58.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 -- 172.21.15.119:0/2144488302 learned_addr learned my addr 172.21.15.119:0/2144488302 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 -- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 msgr2=0x7f90e81df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 -- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90e806fc60 msgr2=0x7f90e8148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90e806fc60 0x7f90e8148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 -- 172.21.15.119:0/2144488302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8149300 con 0x7f90e806cc80 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90e7400640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c530 tx=0x7f90d800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8016020 con 0x7f90e806cc80 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8005220 con 0x7f90e806cc80 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e81482b0 con 0x7f90e806cc80 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8007030 con 0x7f90e806cc80 2024-03-08T21:33:58.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.914+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e8149860 con 0x7f90e806cc80 2024-03-08T21:33:58.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e8067db0 con 0x7f90e806cc80 2024-03-08T21:33:58.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f90d80071d0 con 0x7f90e806cc80 2024-03-08T21:33:58.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90dfe00640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 0x7f90c4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:58.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90d80852b0 con 0x7f90e806cc80 2024-03-08T21:33:58.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90dea00640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 0x7f90c4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:58.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.918+0000 7f90dea00640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 0x7f90c4069b20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90d00af000 tx=0x7f90d0004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:58.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:58.922+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f90d8020020 con 0x7f90e806cc80 2024-03-08T21:33:59.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.078+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e80b6b50 con 0x7f90e806cc80 2024-03-08T21:33:59.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.078+0000 7f90dfe00640 1 -- 172.21.15.119:0/2144488302 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f90e8149300 con 0x7f90e806cc80 2024-03-08T21:33:59.065 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:33:59.065 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:33:59.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 msgr2=0x7f90c4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 0x7f90c4069b20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f90d00af000 tx=0x7f90d0004740 comp rx=0 tx=0).stop 2024-03-08T21:33:59.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 msgr2=0x7f90e813f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c530 tx=0x7f90d800c9f0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 shutdown_connections 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90c4067660 0x7f90c4069b20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e8140d10 0x7f90e81df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90e806fc60 0x7f90e8148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 --2- 172.21.15.119:0/2144488302 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90e806cc80 0x7f90e813f4a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 >> 172.21.15.119:0/2144488302 conn(0x7f90e80b8820 msgr2=0x7f90e80b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 shutdown_connections 2024-03-08T21:33:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.082+0000 7f90ee800640 1 -- 172.21.15.119:0/2144488302 wait complete. 2024-03-08T21:33:59.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:33:59.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:33:59.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 Processor -- start 2024-03-08T21:33:59.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 -- start start 2024-03-08T21:33:59.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa230144670 0x7fa2301528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300ae740 con 0x7fa230066d30 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa230144a80 con 0x7fa2300af550 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa235c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa230067110 con 0x7fa230144670 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22ea00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa230066d30 0x7fa2300aee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51046/0 (socket says 172.21.15.119:51046) 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22ea00640 1 -- 172.21.15.119:0/3678653133 learned_addr learned my addr 172.21.15.119:0/3678653133 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22f400640 1 --2- 172.21.15.119:0/3678653133 >> v2:172.21.15.119:3300/0 conn(0x7fa230144670 0x7fa2301528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22e000640 1 -- 172.21.15.119:0/3678653133 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774692793 0 0) 0x7fa2300ae740 con 0x7fa230066d30 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22e000640 1 -- 172.21.15.119:0/3678653133 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa214003530 con 0x7fa230066d30 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22f400640 1 -- 172.21.15.119:0/3678653133 >> v1:172.21.15.160:6789/0 conn(0x7fa2300af550 legacy=0x7fa230143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.238+0000 7fa22f400640 1 -- 172.21.15.119:0/3678653133 >> v1:172.21.15.119:6789/0 conn(0x7fa230066d30 legacy=0x7fa2300aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa22f400640 1 -- 172.21.15.119:0/3678653133 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300b4c20 con 0x7fa230144670 2024-03-08T21:33:59.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa22f400640 1 --2- 172.21.15.119:0/3678653133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2301528a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa228009d90 tx=0x7fa22801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5269ca5a752228cb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa22e000640 1 -- 172.21.15.119:0/3678653133 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280b2070 con 0x7fa230144670 2024-03-08T21:33:59.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa22e000640 1 -- 172.21.15.119:0/3678653133 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280a5850 con 0x7fa230144670 2024-03-08T21:33:59.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa22e000640 1 -- 172.21.15.119:0/3678653133 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280a5c20 con 0x7fa230144670 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 -- 172.21.15.119:0/3678653133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 msgr2=0x7fa2301528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 --2- 172.21.15.119:0/3678653133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2301528a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa228009d90 tx=0x7fa22801c8a0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 -- 172.21.15.119:0/3678653133 shutdown_connections 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 --2- 172.21.15.119:0/3678653133 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2301528a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 -- 172.21.15.119:0/3678653133 >> 172.21.15.119:0/3678653133 conn(0x7fa2300b5770 msgr2=0x7fa2300b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 -- 172.21.15.119:0/3678653133 shutdown_connections 2024-03-08T21:33:59.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.242+0000 7fa235c00640 1 -- 172.21.15.119:0/3678653133 wait complete. 2024-03-08T21:33:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 Processor -- start 2024-03-08T21:33:59.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- start start 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa230066d30 0x7fa2300b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2300af550 0x7fa2300b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300b47c0 con 0x7fa230144670 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006e300 con 0x7fa2300af550 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300b4940 con 0x7fa230066d30 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44060/0 (socket says 172.21.15.119:44060) 2024-03-08T21:33:59.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 -- 172.21.15.119:0/3157130787 learned_addr learned my addr 172.21.15.119:0/3157130787 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22ea00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa230066d30 0x7fa2300b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa226000640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2300af550 0x7fa2300b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 -- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa230066d30 msgr2=0x7fa2300b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa230066d30 0x7fa2300b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 -- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2300af550 msgr2=0x7fa2300b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2300af550 0x7fa2300b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 -- 172.21.15.119:0/3157130787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300b2080 con 0x7fa230144670 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa22f400640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2280b0040 tx=0x7fa228019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280b2050 con 0x7fa230144670 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280be070 con 0x7fa230144670 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280ada90 con 0x7fa230144670 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23013b700 con 0x7fa230144670 2024-03-08T21:33:59.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.246+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23013c910 con 0x7fa230144670 2024-03-08T21:33:59.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa230067db0 con 0x7fa230144670 2024-03-08T21:33:59.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa2280a56d0 con 0x7fa230144670 2024-03-08T21:33:59.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa227400640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 0x7fa20c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa228120af0 con 0x7fa230144670 2024-03-08T21:33:59.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa22ea00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 0x7fa20c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.250+0000 7fa22ea00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 0x7fa20c069b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa220005890 tx=0x7fa220009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.254+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa228016520 con 0x7fa230144670 2024-03-08T21:33:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.414+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2300b22f0 con 0x7fa230144670 2024-03-08T21:33:59.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.414+0000 7fa227400640 1 -- 172.21.15.119:0/3157130787 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2280f1880 con 0x7fa230144670 2024-03-08T21:33:59.402 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 msgr2=0x7fa20c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 0x7fa20c069b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa220005890 tx=0x7fa220009040 comp rx=0 tx=0).stop 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 msgr2=0x7fa2300b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2280b0040 tx=0x7fa228019640 comp rx=0 tx=0).stop 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 shutdown_connections 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa20c067660 0x7fa20c069b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa230144670 0x7fa2300b0e70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2300af550 0x7fa2300b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 --2- 172.21.15.119:0/3157130787 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa230066d30 0x7fa2300b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 >> 172.21.15.119:0/3157130787 conn(0x7fa2300b5770 msgr2=0x7fa2300b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 shutdown_connections 2024-03-08T21:33:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.418+0000 7fa235c00640 1 -- 172.21.15.119:0/3157130787 wait complete. 2024-03-08T21:33:59.422 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:33:59.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 Processor -- start 2024-03-08T21:33:59.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 -- start start 2024-03-08T21:33:59.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 0x7fd1380b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd138140fb0 0x7fd1381413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13806cc20 con 0x7fd13806c840 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380b3670 con 0x7fd138140fb0 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd13e200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380b3950 con 0x7fd138144740 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd138140fb0 0x7fd1381413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd138140fb0 0x7fd1381413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44064/0 (socket says 172.21.15.119:44064) 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 -- 172.21.15.119:0/3985068068 learned_addr learned my addr 172.21.15.119:0/3985068068 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 -- 172.21.15.119:0/3985068068 >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 msgr2=0x7fd1380b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd136a00640 1 --2- 172.21.15.119:0/3985068068 >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 0x7fd1380b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 --2- 172.21.15.119:0/3985068068 >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 0x7fd1380b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 -- 172.21.15.119:0/3985068068 >> v1:172.21.15.160:6789/0 conn(0x7fd13806c840 legacy=0x7fd138144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd137e00640 1 -- 172.21.15.119:0/3985068068 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380b3c30 con 0x7fd138140fb0 2024-03-08T21:33:59.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.574+0000 7fd136a00640 1 --2- 172.21.15.119:0/3985068068 >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 0x7fd1380b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:59.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd137e00640 1 --2- 172.21.15.119:0/3985068068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138140fb0 0x7fd1381413c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd13806bac0 tx=0x7fd13001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a6b01e78513c73 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd136000640 1 -- 172.21.15.119:0/3985068068 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300a56f0 con 0x7fd138140fb0 2024-03-08T21:33:59.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd136000640 1 -- 172.21.15.119:0/3985068068 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300a5890 con 0x7fd138140fb0 2024-03-08T21:33:59.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd136000640 1 -- 172.21.15.119:0/3985068068 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300a5c60 con 0x7fd138140fb0 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- 172.21.15.119:0/3985068068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138140fb0 msgr2=0x7fd1381413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 --2- 172.21.15.119:0/3985068068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138140fb0 0x7fd1381413c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd13806bac0 tx=0x7fd13001c920 comp rx=0 tx=0).stop 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- 172.21.15.119:0/3985068068 shutdown_connections 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 --2- 172.21.15.119:0/3985068068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138140fb0 0x7fd1381413c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 --2- 172.21.15.119:0/3985068068 >> v2:172.21.15.160:3300/0 conn(0x7fd138144740 0x7fd1380b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- 172.21.15.119:0/3985068068 >> 172.21.15.119:0/3985068068 conn(0x7fd13809a230 msgr2=0x7fd13809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- 172.21.15.119:0/3985068068 shutdown_connections 2024-03-08T21:33:59.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- 172.21.15.119:0/3985068068 wait complete. 2024-03-08T21:33:59.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 Processor -- start 2024-03-08T21:33:59.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.578+0000 7fd13e200640 1 -- start start 2024-03-08T21:33:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 0x7fd13813b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 0x7fd1380972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138150de0 con 0x7fd138144740 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13806e190 con 0x7fd13806c840 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd138150f60 con 0x7fd138140fb0 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44078/0 (socket says 172.21.15.119:44078) 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 -- 172.21.15.119:0/1004715887 learned_addr learned my addr 172.21.15.119:0/1004715887 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd136a00640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 0x7fd1380972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 -- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 msgr2=0x7fd1380972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 0x7fd1380972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 -- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 msgr2=0x7fd13813b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137400640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 0x7fd13813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 0x7fd13813b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 -- 172.21.15.119:0/1004715887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13813cd00 con 0x7fd138144740 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd136a00640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 0x7fd1380972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137400640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 0x7fd13813b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd137e00640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1300af040 tx=0x7fd1300196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300bc020 con 0x7fd138144740 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300b8670 con 0x7fd138144740 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b8a60 con 0x7fd138144740 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1381407c0 con 0x7fd138144740 2024-03-08T21:33:59.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13813cf70 con 0x7fd138144740 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138067db0 con 0x7fd138144740 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.582+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd1300bf020 con 0x7fd138144740 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.586+0000 7fd12f400640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 0x7fd118069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.586+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd130120a60 con 0x7fd138144740 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.586+0000 7fd137400640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 0x7fd118069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.586+0000 7fd137400640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 0x7fd118069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd138074bf0 tx=0x7fd128008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.590+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd1300c6030 con 0x7fd138144740 2024-03-08T21:33:59.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.742+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1381480c0 con 0x7fd138144740 2024-03-08T21:33:59.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.742+0000 7fd12f400640 1 -- 172.21.15.119:0/1004715887 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1300165a0 con 0x7fd138144740 2024-03-08T21:33:59.729 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 msgr2=0x7fd118069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 0x7fd118069b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd138074bf0 tx=0x7fd128008040 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 msgr2=0x7fd138097800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1300af040 tx=0x7fd1300196c0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 shutdown_connections 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd118067660 0x7fd118069b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd138144740 0x7fd138097800 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd138140fb0 0x7fd1380972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 --2- 172.21.15.119:0/1004715887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd13806c840 0x7fd13813b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 >> 172.21.15.119:0/1004715887 conn(0x7fd13809a230 msgr2=0x7fd13806ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 shutdown_connections 2024-03-08T21:33:59.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.746+0000 7fd13e200640 1 -- 172.21.15.119:0/1004715887 wait complete. 2024-03-08T21:33:59.749 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:33:59.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 Processor -- start 2024-03-08T21:33:59.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 -- start start 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fece0142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fece00b4690 0x7fece014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece006e0b0 con 0x7fece00b42b0 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece01456a0 con 0x7fece00b4690 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fece5200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00b3850 con 0x7fece0145b30 2024-03-08T21:33:59.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fecdde00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fece00b42b0 0x7fece006c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51050/0 (socket says 172.21.15.119:51050) 2024-03-08T21:33:59.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.898+0000 7fecdde00640 1 -- 172.21.15.119:0/2059706463 learned_addr learned my addr 172.21.15.119:0/2059706463 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686512339 0 0) 0x7fece006e0b0 con 0x7fece00b42b0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecd5400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fece0142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc4003530 con 0x7fece00b42b0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 --2- 172.21.15.119:0/2059706463 >> v2:172.21.15.160:3300/0 conn(0x7fece00b4690 0x7fece014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 707908418 0 0) 0x7fecc4003530 con 0x7fece00b42b0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 msgr2=0x7fece0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fece0142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 >> v2:172.21.15.160:3300/0 conn(0x7fece00b4690 msgr2=0x7fece014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 --2- 172.21.15.119:0/2059706463 >> v2:172.21.15.160:3300/0 conn(0x7fece00b4690 0x7fece014f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0145050 con 0x7fece00b42b0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fecd0001680 con 0x7fece00b42b0 2024-03-08T21:33:59.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 >> v1:172.21.15.119:6789/0 conn(0x7fece00b42b0 legacy=0x7fece006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fecc40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc4003f40 0x7fecc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fecc40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece01456a0 con 0x7fecc4004d50 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00b3850 con 0x7fecc4003f40 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400ba20 con 0x7fece0145b30 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fecc40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecdde00640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fecc40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecd5400640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc4003f40 0x7fecc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 -- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 msgr2=0x7fecc40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece0145b30 0x7fecc40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 -- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc4003f40 msgr2=0x7fecc4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecc4003f40 0x7fecc4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.902+0000 7fecde800640 1 -- 172.21.15.119:0/2059706463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4003530 con 0x7fecc4004d50 2024-03-08T21:33:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecde800640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fecc40051d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e170 tx=0x7fecd801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8165b344f2242f92 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd80b0070 con 0x7fecc4004d50 2024-03-08T21:33:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80ab600 con 0x7fecc4004d50 2024-03-08T21:33:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdd400640 1 -- 172.21.15.119:0/2059706463 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8009c10 con 0x7fecc4004d50 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- 172.21.15.119:0/2059706463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 msgr2=0x7fecc40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 --2- 172.21.15.119:0/2059706463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fecc40051d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fecd800e170 tx=0x7fecd801c980 comp rx=0 tx=0).stop 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecde800640 1 -- 172.21.15.119:0/2059706463 reap_dead start 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- 172.21.15.119:0/2059706463 shutdown_connections 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- 172.21.15.119:0/2059706463 >> 172.21.15.119:0/2059706463 conn(0x7fece009a230 msgr2=0x7fece009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- 172.21.15.119:0/2059706463 shutdown_connections 2024-03-08T21:33:59.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- 172.21.15.119:0/2059706463 wait complete. 2024-03-08T21:33:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 Processor -- start 2024-03-08T21:33:59.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- start start 2024-03-08T21:33:59.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 0x7fece0071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 0x7fece0071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece014b6c0 con 0x7fecc4004d50 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece01429a0 con 0x7fece00af200 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fece5200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece014b840 con 0x7fece00ae540 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdde00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdde00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44106/0 (socket says 172.21.15.119:44106) 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecdde00640 1 -- 172.21.15.119:0/2831591598 learned_addr learned my addr 172.21.15.119:0/2831591598 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.906+0000 7fecde800640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 0x7fece0071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd5400640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 0x7fece0071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 -- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 msgr2=0x7fece0071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 0x7fece0071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 -- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 msgr2=0x7fece0071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 0x7fece0071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 -- 172.21.15.119:0/2831591598 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0070910 con 0x7fecc4004d50 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecde800640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 0x7fece0071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd5400640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 0x7fece0071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecdde00640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fecd0012520 tx=0x7fecd00129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0014810 con 0x7fecc4004d50 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd001b070 con 0x7fecc4004d50 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0070bf0 con 0x7fecc4004d50 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0014c10 con 0x7fecc4004d50 2024-03-08T21:33:59.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00ad4a0 con 0x7fecc4004d50 2024-03-08T21:33:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece0067db0 con 0x7fecc4004d50 2024-03-08T21:33:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fecd0016480 con 0x7fecc4004d50 2024-03-08T21:33:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 0x7fecbc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:33:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecd0088d70 con 0x7fecc4004d50 2024-03-08T21:33:59.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.910+0000 7fecd5400640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 0x7fecbc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:33:59.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.914+0000 7fecd5400640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 0x7fecbc069b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece0072a90 tx=0x7fecc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:33:59.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:33:59.914+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fecd00599e0 con 0x7fecc4004d50 2024-03-08T21:34:00.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fece009da10 con 0x7fecc4004d50 2024-03-08T21:34:00.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fecd6a00640 1 -- 172.21.15.119:0/2831591598 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecd00592e0 con 0x7fecc4004d50 2024-03-08T21:34:00.060 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 msgr2=0x7fecbc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 0x7fecbc069b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece0072a90 tx=0x7fecc8008040 comp rx=0 tx=0).stop 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 msgr2=0x7fece014a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fecd0012520 tx=0x7fecd00129e0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 shutdown_connections 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fecbc067660 0x7fecbc069b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fece00ae540 0x7fece0071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fece00af200 0x7fece0071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 --2- 172.21.15.119:0/2831591598 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecc4004d50 0x7fece014a610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 >> 172.21.15.119:0/2831591598 conn(0x7fece009a230 msgr2=0x7fece00b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 shutdown_connections 2024-03-08T21:34:00.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.074+0000 7fece5200640 1 -- 172.21.15.119:0/2831591598 wait complete. 2024-03-08T21:34:00.081 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 Processor -- start 2024-03-08T21:34:00.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 -- start start 2024-03-08T21:34:00.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 0x7f7110140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711006ddf0 con 0x7f711006da10 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71100b6190 con 0x7f71100b6440 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f7115200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71100b4570 con 0x7f71100b5c70 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710de00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f711006da10 0x7f71100b5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51066/0 (socket says 172.21.15.119:51066) 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710de00640 1 -- 172.21.15.119:0/196664881 learned_addr learned my addr 172.21.15.119:0/196664881 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710d400640 1 --2- 172.21.15.119:0/196664881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 0x7f7110140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297240397 0 0) 0x7f711006ddf0 con 0x7f711006da10 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f4003530 con 0x7f711006da10 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032021876 0 0) 0x7f71100b6190 con 0x7f71100b6440 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.230+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f711006ddf0 con 0x7f71100b6440 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710d400640 1 -- 172.21.15.119:0/196664881 >> v1:172.21.15.160:6789/0 conn(0x7f71100b6440 legacy=0x7f7110151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710d400640 1 -- 172.21.15.119:0/196664881 >> v1:172.21.15.119:6789/0 conn(0x7f711006da10 legacy=0x7f71100b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710d400640 1 -- 172.21.15.119:0/196664881 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100b4850 con 0x7f71100b5c70 2024-03-08T21:34:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710d400640 1 --2- 172.21.15.119:0/196664881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 0x7f7110140d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0097f0 tx=0x7f70fc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1448bfe9173c0acf server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0b0070 con 0x7f71100b5c70 2024-03-08T21:34:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc0ab600 con 0x7f71100b5c70 2024-03-08T21:34:00.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f710ca00640 1 -- 172.21.15.119:0/196664881 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0ab9d0 con 0x7f71100b5c70 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f7115200640 1 -- 172.21.15.119:0/196664881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 msgr2=0x7f7110140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f7115200640 1 --2- 172.21.15.119:0/196664881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 0x7f7110140d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0097f0 tx=0x7f70fc01c450 comp rx=0 tx=0).stop 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f7115200640 1 -- 172.21.15.119:0/196664881 shutdown_connections 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f7115200640 1 --2- 172.21.15.119:0/196664881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71100b5c70 0x7f7110140d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.234+0000 7f7115200640 1 -- 172.21.15.119:0/196664881 >> 172.21.15.119:0/196664881 conn(0x7f711006b6e0 msgr2=0x7f71100ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- 172.21.15.119:0/196664881 shutdown_connections 2024-03-08T21:34:00.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- 172.21.15.119:0/196664881 wait complete. 2024-03-08T21:34:00.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 Processor -- start 2024-03-08T21:34:00.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- start start 2024-03-08T21:34:00.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f711006da10 0x7f7110138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71100b5c70 0x7f7110143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101559a0 con 0x7f71100b6440 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7110155b20 con 0x7f71100b5c70 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7110155ca0 con 0x7f711006da10 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44120/0 (socket says 172.21.15.119:44120) 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 -- 172.21.15.119:0/561013406 learned_addr learned my addr 172.21.15.119:0/561013406 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710de00640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f711006da10 0x7f7110138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710d400640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71100b5c70 0x7f7110143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 -- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f711006da10 msgr2=0x7f7110138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f711006da10 0x7f7110138a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 -- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71100b5c70 msgr2=0x7f7110143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71100b5c70 0x7f7110143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 -- 172.21.15.119:0/561013406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110139b00 con 0x7f71100b6440 2024-03-08T21:34:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f710e800640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f710800c760 tx=0x7f710800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108003b80 con 0x7f71100b6440 2024-03-08T21:34:00.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7108003d20 con 0x7f71100b6440 2024-03-08T21:34:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800aa90 con 0x7f71100b6440 2024-03-08T21:34:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7110139de0 con 0x7f71100b6440 2024-03-08T21:34:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.238+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7110139690 con 0x7f71100b6440 2024-03-08T21:34:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7110146740 con 0x7f71100b6440 2024-03-08T21:34:00.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f710800ac30 con 0x7f71100b6440 2024-03-08T21:34:00.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f7106000640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 0x7f70f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71080855f0 con 0x7f71100b6440 2024-03-08T21:34:00.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f710de00640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 0x7f70f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.242+0000 7f710de00640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 0x7f70f0069b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7100007fd0 tx=0x7f7100007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.246+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7108055cb0 con 0x7f71100b6440 2024-03-08T21:34:00.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.438+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7110067db0 con 0x7f71100b6440 2024-03-08T21:34:00.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.438+0000 7f7106000640 1 -- 172.21.15.119:0/561013406 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7f7108059d50 con 0x7f71100b6440 2024-03-08T21:34:00.427 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:00.427 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:00.427 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:00.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 msgr2=0x7f70f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 0x7f70f0069b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7100007fd0 tx=0x7f7100007d80 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 msgr2=0x7f71101dff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f710800c760 tx=0x7f710800cc20 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 shutdown_connections 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70f0067660 0x7f70f0069b20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71100b6440 0x7f71101dff00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71100b5c70 0x7f7110143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 --2- 172.21.15.119:0/561013406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f711006da10 0x7f7110138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 >> 172.21.15.119:0/561013406 conn(0x7f711006b6e0 msgr2=0x7f7110071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 shutdown_connections 2024-03-08T21:34:00.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.442+0000 7f7115200640 1 -- 172.21.15.119:0/561013406 wait complete. 2024-03-08T21:34:00.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 Processor -- start 2024-03-08T21:34:00.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 -- start start 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f16f4099ca0 0x7f16f413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f409afe0 0x7f16f40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f409a080 con 0x7f16f413f2c0 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40b4b60 con 0x7f16f409afe0 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16fb200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f40b4510 con 0x7f16f4099ca0 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f409afe0 0x7f16f40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16f409afe0 0x7f16f40b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44132/0 (socket says 172.21.15.119:44132) 2024-03-08T21:34:00.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 -- 172.21.15.119:0/684078733 learned_addr learned my addr 172.21.15.119:0/684078733 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f3e00640 1 --2- 172.21.15.119:0/684078733 >> v2:172.21.15.160:3300/0 conn(0x7f16f4099ca0 0x7f16f413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 -- 172.21.15.119:0/684078733 >> v2:172.21.15.160:3300/0 conn(0x7f16f4099ca0 msgr2=0x7f16f413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 --2- 172.21.15.119:0/684078733 >> v2:172.21.15.160:3300/0 conn(0x7f16f4099ca0 0x7f16f413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 -- 172.21.15.119:0/684078733 >> v1:172.21.15.160:6789/0 conn(0x7f16f413f2c0 legacy=0x7f16f409a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:00.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.598+0000 7f16f9200640 1 -- 172.21.15.119:0/684078733 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40b47f0 con 0x7f16f409afe0 2024-03-08T21:34:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16f9200640 1 --2- 172.21.15.119:0/684078733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40b1d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16f40b4ce0 tx=0x7f16ec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d7f56595039aa9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16f2a00640 1 -- 172.21.15.119:0/684078733 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0aa660 con 0x7f16f409afe0 2024-03-08T21:34:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16f2a00640 1 -- 172.21.15.119:0/684078733 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec0af070 con 0x7f16f409afe0 2024-03-08T21:34:00.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16f2a00640 1 -- 172.21.15.119:0/684078733 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0aaa20 con 0x7f16f409afe0 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- 172.21.15.119:0/684078733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 msgr2=0x7f16f40b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 --2- 172.21.15.119:0/684078733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40b1d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16f40b4ce0 tx=0x7f16ec01c4e0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- 172.21.15.119:0/684078733 shutdown_connections 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 --2- 172.21.15.119:0/684078733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40b1d30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 --2- 172.21.15.119:0/684078733 >> v2:172.21.15.160:3300/0 conn(0x7f16f4099ca0 0x7f16f413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- 172.21.15.119:0/684078733 >> 172.21.15.119:0/684078733 conn(0x7f16f406c620 msgr2=0x7f16f406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- 172.21.15.119:0/684078733 shutdown_connections 2024-03-08T21:34:00.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- 172.21.15.119:0/684078733 wait complete. 2024-03-08T21:34:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 Processor -- start 2024-03-08T21:34:00.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.602+0000 7f16fb200640 1 -- start start 2024-03-08T21:34:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16f4099ca0 0x7f16f40b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16f413f2c0 0x7f16f40ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f41522d0 con 0x7f16f409afe0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4152150 con 0x7f16f4099ca0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4152450 con 0x7f16f413f2c0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44134/0 (socket says 172.21.15.119:44134) 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 -- 172.21.15.119:0/1502443536 learned_addr learned my addr 172.21.15.119:0/1502443536 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16f4099ca0 0x7f16f40b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f9200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16f413f2c0 0x7f16f40ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 -- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16f413f2c0 msgr2=0x7f16f40ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16f413f2c0 0x7f16f40ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 -- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16f4099ca0 msgr2=0x7f16f40b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16f4099ca0 0x7f16f40b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 -- 172.21.15.119:0/1502443536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40b17d0 con 0x7f16f409afe0 2024-03-08T21:34:00.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16f3400640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b410 tx=0x7f16e000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0015030 con 0x7f16f409afe0 2024-03-08T21:34:00.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0004020 con 0x7f16f409afe0 2024-03-08T21:34:00.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f40b7e30 con 0x7f16f409afe0 2024-03-08T21:34:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e0004450 con 0x7f16f409afe0 2024-03-08T21:34:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f40b74f0 con 0x7f16f409afe0 2024-03-08T21:34:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f4067db0 con 0x7f16f409afe0 2024-03-08T21:34:00.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.606+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f16e0018070 con 0x7f16f409afe0 2024-03-08T21:34:00.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.610+0000 7f16ebe00640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 0x7f16d4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.610+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16e0085270 con 0x7f16f409afe0 2024-03-08T21:34:00.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.610+0000 7f16f3e00640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 0x7f16d4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.610+0000 7f16f3e00640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 0x7f16d4069b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16e4003b90 tx=0x7f16e40098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.614+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f16e0055930 con 0x7f16f409afe0 2024-03-08T21:34:00.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.770+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f40af050 con 0x7f16f409afe0 2024-03-08T21:34:00.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.770+0000 7f16ebe00640 1 -- 172.21.15.119:0/1502443536 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f16e00599d0 con 0x7f16f409afe0 2024-03-08T21:34:00.758 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:00.758 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 msgr2=0x7f16d4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 0x7f16d4069b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16e4003b90 tx=0x7f16e40098d0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 msgr2=0x7f16f40ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b410 tx=0x7f16e000b8d0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 shutdown_connections 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f16d4067690 0x7f16d4069b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16f413f2c0 0x7f16f40ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16f409afe0 0x7f16f40ad540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 --2- 172.21.15.119:0/1502443536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16f4099ca0 0x7f16f40b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 >> 172.21.15.119:0/1502443536 conn(0x7f16f406c620 msgr2=0x7f16f413c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 shutdown_connections 2024-03-08T21:34:00.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.774+0000 7f16fb200640 1 -- 172.21.15.119:0/1502443536 wait complete. 2024-03-08T21:34:00.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:00.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:00.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 Processor -- start 2024-03-08T21:34:00.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 -- start start 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f985c0b4690 0x7f985c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c06e0b0 con 0x7f985c145b30 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c142a90 con 0x7f985c0b4690 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9861600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1456a0 con 0x7f985c0b42b0 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f985c0b4690 0x7f985c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f985c0b4690 0x7f985c14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44144/0 (socket says 172.21.15.119:44144) 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985a000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f985c145b30 0x7f985c142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51076/0 (socket says 172.21.15.119:51076) 2024-03-08T21:34:00.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 -- 172.21.15.119:0/3646497935 learned_addr learned my addr 172.21.15.119:0/3646497935 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:00.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985aa00640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 -- 172.21.15.119:0/3646497935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 msgr2=0x7f985c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:00.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 -- 172.21.15.119:0/3646497935 >> v1:172.21.15.119:6789/0 conn(0x7f985c145b30 legacy=0x7f985c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f985b400640 1 -- 172.21.15.119:0/3646497935 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c145050 con 0x7f985c0b4690 2024-03-08T21:34:00.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.930+0000 7f9859600640 1 -- 172.21.15.119:0/3646497935 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432357257 0 0) 0x7f985c06e0b0 con 0x7f985c145b30 2024-03-08T21:34:00.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f985b400640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c14f6e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9854009870 tx=0x7f985401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb95b2d5b3e5d79 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9859600640 1 -- 172.21.15.119:0/3646497935 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540b0070 con 0x7f985c0b4690 2024-03-08T21:34:00.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9859600640 1 -- 172.21.15.119:0/3646497935 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98540ab600 con 0x7f985c0b4690 2024-03-08T21:34:00.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9859600640 1 -- 172.21.15.119:0/3646497935 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540ab9d0 con 0x7f985c0b4690 2024-03-08T21:34:00.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 -- 172.21.15.119:0/3646497935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 msgr2=0x7f985c14f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c14f6e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9854009870 tx=0x7f985401c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 -- 172.21.15.119:0/3646497935 shutdown_connections 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c14f6e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 --2- 172.21.15.119:0/3646497935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 -- 172.21.15.119:0/3646497935 >> 172.21.15.119:0/3646497935 conn(0x7f985c09a230 msgr2=0x7f985c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 -- 172.21.15.119:0/3646497935 shutdown_connections 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.934+0000 7f9861600640 1 -- 172.21.15.119:0/3646497935 wait complete. 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 Processor -- start 2024-03-08T21:34:00.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- start start 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c145b30 0x7f985c140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1527d0 con 0x7f985c0b4690 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c152650 con 0x7f985c145b30 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c152950 con 0x7f985c0b42b0 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44154/0 (socket says 172.21.15.119:44154) 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 -- 172.21.15.119:0/1701628179 learned_addr learned my addr 172.21.15.119:0/1701628179 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985aa00640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985b400640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c145b30 0x7f985c140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 -- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 msgr2=0x7f985c0aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c0aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 -- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c145b30 msgr2=0x7f985c140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c145b30 0x7f985c140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 -- 172.21.15.119:0/1701628179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c140950 con 0x7f985c0b4690 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f985a000640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f984800c480 tx=0x7f984800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848018070 con 0x7f985c0b4690 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98480074e0 con 0x7f985c0b4690 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98480049f0 con 0x7f985c0b4690 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c140c20 con 0x7f985c0b4690 2024-03-08T21:34:00.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.938+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0ad4a0 con 0x7f985c0b4690 2024-03-08T21:34:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c067db0 con 0x7f985c0b4690 2024-03-08T21:34:00.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9848004b90 con 0x7f985c0b4690 2024-03-08T21:34:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f9852a00640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 0x7f983c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9848084b30 con 0x7f985c0b4690 2024-03-08T21:34:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f985aa00640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 0x7f983c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:00.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.942+0000 7f985aa00640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 0x7f983c069b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f984c003b90 tx=0x7f984c0098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:00.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:00.946+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f9848055150 con 0x7f985c0b4690 2024-03-08T21:34:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f985c09da10 con 0x7f985c0b4690 2024-03-08T21:34:01.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9852a00640 1 -- 172.21.15.119:0/1701628179 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98480591f0 con 0x7f985c0b4690 2024-03-08T21:34:01.088 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 msgr2=0x7f983c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 0x7f983c069b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f984c003b90 tx=0x7f984c0098d0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 msgr2=0x7f985c1df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f984800c480 tx=0x7f984800c940 comp rx=0 tx=0).stop 2024-03-08T21:34:01.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 shutdown_connections 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f983c067690 0x7f983c069b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c145b30 0x7f985c140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c0b4690 0x7f985c1df860 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 --2- 172.21.15.119:0/1701628179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b42b0 0x7f985c0aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 >> 172.21.15.119:0/1701628179 conn(0x7f985c09a230 msgr2=0x7f985c143b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 shutdown_connections 2024-03-08T21:34:01.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.102+0000 7f9861600640 1 -- 172.21.15.119:0/1701628179 wait complete. 2024-03-08T21:34:01.108 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.258+0000 7f13dfe00640 1 Processor -- start 2024-03-08T21:34:01.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.258+0000 7f13dfe00640 1 -- start start 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dfe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13e0140d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dfe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e006bc10 con 0x7f13e006d780 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dfe00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e006b4c0 con 0x7f13e0141280 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dfe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006ad50 con 0x7f13e006e060 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dea00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f13e006d780 0x7f13e00b5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51090/0 (socket says 172.21.15.119:51090) 2024-03-08T21:34:01.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dea00640 1 -- 172.21.15.119:0/2908925448 learned_addr learned my addr 172.21.15.119:0/2908925448 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13de000640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13e0140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510108368 0 0) 0x7f13e006bc10 con 0x7f13e006d780 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c4003530 con 0x7f13e006d780 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1090909742 0 0) 0x7f13c4003530 con 0x7f13e006d780 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 msgr2=0x7f13e0140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:01.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13e0140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 >> v1:172.21.15.160:6789/0 conn(0x7f13e0141280 legacy=0x7f13e0151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e006db60 con 0x7f13e006d780 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f13d0001680 con 0x7f13e006d780 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 >> v1:172.21.15.119:6789/0 conn(0x7f13e006d780 legacy=0x7f13e00b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13c40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c4003fc0 0x7f13c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006ad50 con 0x7f13c4004d50 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c400bbc0 con 0x7f13c4003fc0 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c400bdc0 con 0x7f13e006e060 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13de000640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c4003fc0 0x7f13c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13dea00640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13c40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 -- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 msgr2=0x7f13c40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e006e060 0x7f13c40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 -- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c4003fc0 msgr2=0x7f13c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c4003fc0 0x7f13c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.262+0000 7f13df400640 1 -- 172.21.15.119:0/2908925448 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4003530 con 0x7f13c4004d50 2024-03-08T21:34:01.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13df400640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13c40051d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13d8001e70 tx=0x7f13d801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8e6c868eb595dd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8001a90 con 0x7f13c4004d50 2024-03-08T21:34:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d8003b80 con 0x7f13c4004d50 2024-03-08T21:34:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dd600640 1 -- 172.21.15.119:0/2908925448 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007e60 con 0x7f13c4004d50 2024-03-08T21:34:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- 172.21.15.119:0/2908925448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 msgr2=0x7f13c40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2908925448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13c40051d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13d8001e70 tx=0x7f13d801c780 comp rx=0 tx=0).stop 2024-03-08T21:34:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13df400640 1 -- 172.21.15.119:0/2908925448 reap_dead start 2024-03-08T21:34:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- 172.21.15.119:0/2908925448 shutdown_connections 2024-03-08T21:34:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- 172.21.15.119:0/2908925448 >> 172.21.15.119:0/2908925448 conn(0x7f13e009b140 msgr2=0x7f13e009b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- 172.21.15.119:0/2908925448 shutdown_connections 2024-03-08T21:34:01.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- 172.21.15.119:0/2908925448 wait complete. 2024-03-08T21:34:01.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 Processor -- start 2024-03-08T21:34:01.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.266+0000 7f13dfe00640 1 -- start start 2024-03-08T21:34:01.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13e01dd040 0x7f13e014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e0149170 0x7f13e0149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006e980 con 0x7f13c4004d50 2024-03-08T21:34:01.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006e4a0 con 0x7f13e01dd040 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e006b740 con 0x7f13e0149170 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44178/0 (socket says 172.21.15.119:44178) 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 -- 172.21.15.119:0/2336750235 learned_addr learned my addr 172.21.15.119:0/2336750235 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13de000640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13e01dd040 0x7f13e014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13df400640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e0149170 0x7f13e0149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 -- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e0149170 msgr2=0x7f13e0149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e0149170 0x7f13e0149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 -- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13e01dd040 msgr2=0x7f13e014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13e01dd040 0x7f13e014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 -- 172.21.15.119:0/2336750235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e013db20 con 0x7f13c4004d50 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dea00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012490 tx=0x7f13d0012890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d001c070 con 0x7f13c4004d50 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0000ee0 con 0x7f13c4004d50 2024-03-08T21:34:01.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00149b0 con 0x7f13c4004d50 2024-03-08T21:34:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e0144430 con 0x7f13c4004d50 2024-03-08T21:34:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e01dcb20 con 0x7f13c4004d50 2024-03-08T21:34:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e01dcd20 con 0x7f13c4004d50 2024-03-08T21:34:01.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.270+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f13d0014b50 con 0x7f13c4004d50 2024-03-08T21:34:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.274+0000 7f13d6a00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 0x7f13c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.274+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13d0087f10 con 0x7f13c4004d50 2024-03-08T21:34:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.274+0000 7f13de000640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 0x7f13c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.274+0000 7f13de000640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 0x7f13c0069b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e00727a0 tx=0x7f13cc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.278+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f13e01dcd20 con 0x7f13c4004d50 2024-03-08T21:34:01.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13e00684c0 con 0x7f13c4004d50 2024-03-08T21:34:01.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13d6a00640 1 -- 172.21.15.119:0/2336750235 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13d0058530 con 0x7f13c4004d50 2024-03-08T21:34:01.421 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 msgr2=0x7f13c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 0x7f13c0069b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13e00727a0 tx=0x7f13cc009190 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 msgr2=0x7f13e01487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012490 tx=0x7f13d0012890 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 shutdown_connections 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f13c0067660 0x7f13c0069b20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13e0149170 0x7f13e0149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13e01dd040 0x7f13e014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 --2- 172.21.15.119:0/2336750235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c4004d50 0x7f13e01487c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 >> 172.21.15.119:0/2336750235 conn(0x7f13e009b140 msgr2=0x7f13e0072810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 shutdown_connections 2024-03-08T21:34:01.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.434+0000 7f13dfe00640 1 -- 172.21.15.119:0/2336750235 wait complete. 2024-03-08T21:34:01.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:01.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.590+0000 7f40cae00640 1 Processor -- start 2024-03-08T21:34:01.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.590+0000 7f40cae00640 1 -- start start 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.590+0000 7f40cae00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40c4145b30 0x7f40c4142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.590+0000 7f40cae00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c406e0b0 con 0x7f40c40b4690 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40cae00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c4145050 con 0x7f40c40b42b0 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40cae00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c41456a0 con 0x7f40c4145b30 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40c4145b30 0x7f40c4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f40c4145b30 0x7f40c4142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44188/0 (socket says 172.21.15.119:44188) 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 -- 172.21.15.119:0/2153388764 learned_addr learned my addr 172.21.15.119:0/2153388764 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 -- 172.21.15.119:0/2153388764 >> v1:172.21.15.160:6789/0 conn(0x7f40c40b42b0 legacy=0x7f40c406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 -- 172.21.15.119:0/2153388764 >> v1:172.21.15.119:6789/0 conn(0x7f40c40b4690 legacy=0x7f40c414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 -- 172.21.15.119:0/2153388764 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4145330 con 0x7f40c4145b30 2024-03-08T21:34:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c3400640 1 --2- 172.21.15.119:0/2153388764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c4145b30 0x7f40c4142380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c4145820 tx=0x7f40b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f44e636abbe64e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c2a00640 1 -- 172.21.15.119:0/2153388764 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00b0070 con 0x7f40c4145b30 2024-03-08T21:34:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c2a00640 1 -- 172.21.15.119:0/2153388764 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b00ab600 con 0x7f40c4145b30 2024-03-08T21:34:01.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.594+0000 7f40c2a00640 1 -- 172.21.15.119:0/2153388764 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00ab9d0 con 0x7f40c4145b30 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/2153388764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c4145b30 msgr2=0x7f40c4142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 --2- 172.21.15.119:0/2153388764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c4145b30 0x7f40c4142380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40c4145820 tx=0x7f40b001c4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/2153388764 shutdown_connections 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 --2- 172.21.15.119:0/2153388764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c4145b30 0x7f40c4142380 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/2153388764 >> 172.21.15.119:0/2153388764 conn(0x7f40c409a230 msgr2=0x7f40c409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/2153388764 shutdown_connections 2024-03-08T21:34:01.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/2153388764 wait complete. 2024-03-08T21:34:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 Processor -- start 2024-03-08T21:34:01.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- start start 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40c40b4690 0x7f40c40ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 0x7f40c41e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4153830 con 0x7f40c40b42b0 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40b3850 con 0x7f40c4145b30 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41539b0 con 0x7f40c40b4690 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44202/0 (socket says 172.21.15.119:44202) 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 -- 172.21.15.119:0/3219731986 learned_addr learned my addr 172.21.15.119:0/3219731986 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3400640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40c40b4690 0x7f40c40ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c8e00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 0x7f40c41e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 -- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40c40b4690 msgr2=0x7f40c40ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40c40b4690 0x7f40c40ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 -- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 msgr2=0x7f40c41e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 0x7f40c41e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 -- 172.21.15.119:0/3219731986 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c41385a0 con 0x7f40c40b42b0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c8e00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 0x7f40c41e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40c3e00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c820 tx=0x7f40b400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4003b80 con 0x7f40c40b42b0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4003d20 con 0x7f40c40b42b0 2024-03-08T21:34:01.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400aa90 con 0x7f40c40b42b0 2024-03-08T21:34:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40ae970 con 0x7f40c40b42b0 2024-03-08T21:34:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.598+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40aef20 con 0x7f40c40b42b0 2024-03-08T21:34:01.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c4067db0 con 0x7f40c40b42b0 2024-03-08T21:34:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f40b400ac30 con 0x7f40c40b42b0 2024-03-08T21:34:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40bbe00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 0x7f40a4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b4085890 con 0x7f40c40b42b0 2024-03-08T21:34:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40c3400640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 0x7f40a4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.602+0000 7f40c3400640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 0x7f40a4069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40b00ad000 tx=0x7f40b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.606+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f40b4056500 con 0x7f40c40b42b0 2024-03-08T21:34:01.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.758+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40c409da10 con 0x7f40c40b42b0 2024-03-08T21:34:01.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40bbe00640 1 -- 172.21.15.119:0/3219731986 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40b4055e00 con 0x7f40c40b42b0 2024-03-08T21:34:01.747 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 msgr2=0x7f40a4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 0x7f40a4069b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40b00ad000 tx=0x7f40b0008040 comp rx=0 tx=0).stop 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 msgr2=0x7f40c40ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c820 tx=0x7f40b400cce0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 shutdown_connections 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f40a4067660 0x7f40a4069b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40c4145b30 0x7f40c41e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40c40b4690 0x7f40c40ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 --2- 172.21.15.119:0/3219731986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40c40b42b0 0x7f40c40ad700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 >> 172.21.15.119:0/3219731986 conn(0x7f40c409a230 msgr2=0x7f40c4143ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 shutdown_connections 2024-03-08T21:34:01.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.762+0000 7f40cae00640 1 -- 172.21.15.119:0/3219731986 wait complete. 2024-03-08T21:34:01.767 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:01.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 Processor -- start 2024-03-08T21:34:01.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 -- start start 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 0x7ff69c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c09b190 con 0x7ff69c1448b0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c09d240 con 0x7ff69c072fe0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a4200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c09d520 con 0x7ff69c09adb0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a2200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff69c1448b0 0x7ff69c13d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51110/0 (socket says 172.21.15.119:51110) 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a2200640 1 -- 172.21.15.119:0/1178529173 learned_addr learned my addr 172.21.15.119:0/1178529173 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a1800640 1 --2- 172.21.15.119:0/1178529173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 0x7ff69c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179866815 0 0) 0x7ff69c09b190 con 0x7ff69c1448b0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff684003530 con 0x7ff69c1448b0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71356715 0 0) 0x7ff69c09d240 con 0x7ff69c072fe0 2024-03-08T21:34:01.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c09b190 con 0x7ff69c072fe0 2024-03-08T21:34:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265328795 0 0) 0x7ff684003530 con 0x7ff69c1448b0 2024-03-08T21:34:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a1800640 1 -- 172.21.15.119:0/1178529173 >> v1:172.21.15.160:6789/0 conn(0x7ff69c072fe0 legacy=0x7ff69c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a1800640 1 -- 172.21.15.119:0/1178529173 >> v1:172.21.15.119:6789/0 conn(0x7ff69c1448b0 legacy=0x7ff69c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.914+0000 7ff6a1800640 1 -- 172.21.15.119:0/1178529173 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c143c50 con 0x7ff69c09adb0 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a1800640 1 --2- 172.21.15.119:0/1178529173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 0x7ff69c09cbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff6900097f0 tx=0x7ff69001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e153de150e2880 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900b1070 con 0x7ff69c09adb0 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6900ac400 con 0x7ff69c09adb0 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff69be00640 1 -- 172.21.15.119:0/1178529173 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694001a00 con 0x7ff69c09adb0 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 -- 172.21.15.119:0/1178529173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 msgr2=0x7ff69c09cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 --2- 172.21.15.119:0/1178529173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 0x7ff69c09cbf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff6900097f0 tx=0x7ff69001c400 comp rx=0 tx=0).stop 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 -- 172.21.15.119:0/1178529173 shutdown_connections 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 --2- 172.21.15.119:0/1178529173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c09adb0 0x7ff69c09cbf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 -- 172.21.15.119:0/1178529173 >> 172.21.15.119:0/1178529173 conn(0x7ff69c06c620 msgr2=0x7ff69c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 -- 172.21.15.119:0/1178529173 shutdown_connections 2024-03-08T21:34:01.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.918+0000 7ff6a4200640 1 -- 172.21.15.119:0/1178529173 wait complete. 2024-03-08T21:34:01.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 Processor -- start 2024-03-08T21:34:01.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- start start 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff69c072fe0 0x7ff69c070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c1448b0 0x7ff69c0b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c099e10 con 0x7ff69c09adb0 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c099c90 con 0x7ff69c072fe0 2024-03-08T21:34:01.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c099f90 con 0x7ff69c1448b0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44216/0 (socket says 172.21.15.119:44216) 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 -- 172.21.15.119:0/378153009 learned_addr learned my addr 172.21.15.119:0/378153009 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a2200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c1448b0 0x7ff69c0b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a1800640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff69c072fe0 0x7ff69c070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 -- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c1448b0 msgr2=0x7ff69c0b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c1448b0 0x7ff69c0b7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 -- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff69c072fe0 msgr2=0x7ff69c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff69c072fe0 0x7ff69c070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 -- 172.21.15.119:0/378153009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0b29a0 con 0x7ff69c09adb0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a0e00640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c530 tx=0x7ff68800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6880052d0 con 0x7ff69c09adb0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff688005470 con 0x7ff69c09adb0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c072150 con 0x7ff69c09adb0 2024-03-08T21:34:01.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff688012870 con 0x7ff69c09adb0 2024-03-08T21:34:01.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.922+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c071680 con 0x7ff69c09adb0 2024-03-08T21:34:01.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c067db0 con 0x7ff69c09adb0 2024-03-08T21:34:01.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff688012a10 con 0x7ff69c09adb0 2024-03-08T21:34:01.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff699600640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 0x7ff67c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:01.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff688085510 con 0x7ff69c09adb0 2024-03-08T21:34:01.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff6a1800640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 0x7ff67c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:01.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.926+0000 7ff6a1800640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 0x7ff67c069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6900ae000 tx=0x7ff6900a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:01.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:01.930+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff688056100 con 0x7ff69c09adb0 2024-03-08T21:34:02.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.114+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff69c14eff0 con 0x7ff69c09adb0 2024-03-08T21:34:02.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.114+0000 7ff699600640 1 -- 172.21.15.119:0/378153009 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7ff688055a00 con 0x7ff69c09adb0 2024-03-08T21:34:02.101 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:02.101 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:02.102 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:02.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 msgr2=0x7ff67c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 0x7ff67c069b20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff6900ae000 tx=0x7ff6900a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:02.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 msgr2=0x7ff69c071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c530 tx=0x7ff68800c9f0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 shutdown_connections 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff67c067660 0x7ff67c069b20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff69c1448b0 0x7ff69c0b7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff69c09adb0 0x7ff69c071af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 --2- 172.21.15.119:0/378153009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff69c072fe0 0x7ff69c070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 >> 172.21.15.119:0/378153009 conn(0x7ff69c06c620 msgr2=0x7ff69c073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 shutdown_connections 2024-03-08T21:34:02.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.118+0000 7ff6a4200640 1 -- 172.21.15.119:0/378153009 wait complete. 2024-03-08T21:34:02.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:02.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.266+0000 7f2a5a800640 1 Processor -- start 2024-03-08T21:34:02.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.266+0000 7f2a5a800640 1 -- start start 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a5a800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2a54072920 0x7f2a5414b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a5a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072d00 0x7f2a54147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a5a800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54071c50 con 0x7f2a540b5520 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a5a800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a541475d0 con 0x7f2a54072920 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a5a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5414acf0 con 0x7f2a54072d00 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2a540b5520 0x7f2a5406ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:51120/0 (socket says 172.21.15.119:51120) 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53e00640 1 -- 172.21.15.119:0/1104517084 learned_addr learned my addr 172.21.15.119:0/1104517084 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53400640 1 --2- 172.21.15.119:0/1104517084 >> v2:172.21.15.160:3300/0 conn(0x7f2a54072920 0x7f2a5414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a52a00640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072d00 0x7f2a54147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a52000640 1 -- 172.21.15.119:0/1104517084 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998481587 0 0) 0x7f2a54071c50 con 0x7f2a540b5520 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a52000640 1 -- 172.21.15.119:0/1104517084 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a38003530 con 0x7f2a540b5520 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53400640 1 -- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072d00 msgr2=0x7f2a54147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53400640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072d00 0x7f2a54147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53400640 1 -- 172.21.15.119:0/1104517084 >> v1:172.21.15.119:6789/0 conn(0x7f2a540b5520 legacy=0x7f2a5406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.270+0000 7f2a53400640 1 -- 172.21.15.119:0/1104517084 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540721a0 con 0x7f2a54072920 2024-03-08T21:34:02.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a53400640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072920 0x7f2a5414b180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a0de23742c73ded server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a52000640 1 -- 172.21.15.119:0/1104517084 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b0070 con 0x7f2a54072920 2024-03-08T21:34:02.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a52000640 1 -- 172.21.15.119:0/1104517084 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440ab600 con 0x7f2a54072920 2024-03-08T21:34:02.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a52000640 1 -- 172.21.15.119:0/1104517084 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab9b0 con 0x7f2a54072920 2024-03-08T21:34:02.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072920 msgr2=0x7f2a5414b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072920 0x7f2a5414b180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c380 comp rx=0 tx=0).stop 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- 172.21.15.119:0/1104517084 shutdown_connections 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072d00 0x7f2a54147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1104517084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072920 0x7f2a5414b180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- 172.21.15.119:0/1104517084 >> 172.21.15.119:0/1104517084 conn(0x7f2a540b60c0 msgr2=0x7f2a540b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- 172.21.15.119:0/1104517084 shutdown_connections 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- 172.21.15.119:0/1104517084 wait complete. 2024-03-08T21:34:02.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 Processor -- start 2024-03-08T21:34:02.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- start start 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072920 0x7f2a54144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072d00 0x7f2a541e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54154950 con 0x7f2a540b5520 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b5d40 con 0x7f2a54072d00 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.274+0000 7f2a5a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a54154ad0 con 0x7f2a54072920 2024-03-08T21:34:02.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44232/0 (socket says 172.21.15.119:44232) 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 -- 172.21.15.119:0/1223390003 learned_addr learned my addr 172.21.15.119:0/1223390003 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53400640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072920 0x7f2a54144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a52a00640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072d00 0x7f2a541e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 -- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072920 msgr2=0x7f2a54144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072920 0x7f2a54144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 -- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072d00 msgr2=0x7f2a541e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072d00 0x7f2a541e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 -- 172.21.15.119:0/1223390003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540b33d0 con 0x7f2a540b5520 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a53e00640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00caa0 tx=0x7f2a4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c017070 con 0x7f2a540b5520 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00ac00 con 0x7f2a540b5520 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5409a620 con 0x7f2a540b5520 2024-03-08T21:34:02.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c012400 con 0x7f2a540b5520 2024-03-08T21:34:02.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540b1d30 con 0x7f2a540b5520 2024-03-08T21:34:02.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a540b23d0 con 0x7f2a540b5520 2024-03-08T21:34:02.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.278+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2a4c01a070 con 0x7f2a540b5520 2024-03-08T21:34:02.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.282+0000 7f2a4b400640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 0x7f2a34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.282+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a4c085560 con 0x7f2a540b5520 2024-03-08T21:34:02.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.282+0000 7f2a53400640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 0x7f2a34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.282+0000 7f2a53400640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 0x7f2a34069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ad000 tx=0x7f2a440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.282+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2a4c055c20 con 0x7f2a540b5520 2024-03-08T21:34:02.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a54067db0 con 0x7f2a540b5520 2024-03-08T21:34:02.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a4b400640 1 -- 172.21.15.119:0/1223390003 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f2a4c059cc0 con 0x7f2a540b5520 2024-03-08T21:34:02.429 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:02.429 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 msgr2=0x7f2a34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 0x7f2a34069b20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ad000 tx=0x7f2a440a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 msgr2=0x7f2a540b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00caa0 tx=0x7f2a4c00cf60 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 shutdown_connections 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2a34067660 0x7f2a34069b20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a540b5520 0x7f2a540b05e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a54072d00 0x7f2a541e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 --2- 172.21.15.119:0/1223390003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2a54072920 0x7f2a54144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.442+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 >> 172.21.15.119:0/1223390003 conn(0x7f2a540b60c0 msgr2=0x7f2a540b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.446+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 shutdown_connections 2024-03-08T21:34:02.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.446+0000 7f2a5a800640 1 -- 172.21.15.119:0/1223390003 wait complete. 2024-03-08T21:34:02.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 Processor -- start 2024-03-08T21:34:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 -- start start 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe9006afb0 0x7efe900b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efe900afcc0 0x7efe900b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9006b390 con 0x7efe9006d610 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900b4d00 con 0x7efe9006afb0 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe97200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe900af000 con 0x7efe900afcc0 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe9006afb0 0x7efe900b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe9006afb0 0x7efe900b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56344/0 (socket says 172.21.15.119:56344) 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 -- 172.21.15.119:0/3647547368 learned_addr learned my addr 172.21.15.119:0/3647547368 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe87400640 1 --2- 172.21.15.119:0/3647547368 >> v2:172.21.15.160:3300/0 conn(0x7efe900afcc0 0x7efe900b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 -- 172.21.15.119:0/3647547368 >> v2:172.21.15.160:3300/0 conn(0x7efe900afcc0 msgr2=0x7efe900b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:02.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 --2- 172.21.15.119:0/3647547368 >> v2:172.21.15.160:3300/0 conn(0x7efe900afcc0 0x7efe900b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 -- 172.21.15.119:0/3647547368 >> v1:172.21.15.160:6789/0 conn(0x7efe9006d610 legacy=0x7efe9006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:02.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.598+0000 7efe8fe00640 1 -- 172.21.15.119:0/3647547368 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900af2e0 con 0x7efe9006afb0 2024-03-08T21:34:02.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe8fe00640 1 --2- 172.21.15.119:0/3647547368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006afb0 0x7efe900b5190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe9006e690 tx=0x7efe8001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1549259d9564cf83 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe8f400640 1 -- 172.21.15.119:0/3647547368 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800aa5f0 con 0x7efe9006afb0 2024-03-08T21:34:02.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe8f400640 1 -- 172.21.15.119:0/3647547368 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe800af070 con 0x7efe9006afb0 2024-03-08T21:34:02.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe8f400640 1 -- 172.21.15.119:0/3647547368 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800aa9b0 con 0x7efe9006afb0 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- 172.21.15.119:0/3647547368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006afb0 msgr2=0x7efe900b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 --2- 172.21.15.119:0/3647547368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006afb0 0x7efe900b5190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe9006e690 tx=0x7efe8001c490 comp rx=0 tx=0).stop 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- 172.21.15.119:0/3647547368 shutdown_connections 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 --2- 172.21.15.119:0/3647547368 >> v2:172.21.15.160:3300/0 conn(0x7efe900afcc0 0x7efe900b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 --2- 172.21.15.119:0/3647547368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006afb0 0x7efe900b5190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- 172.21.15.119:0/3647547368 >> 172.21.15.119:0/3647547368 conn(0x7efe900b9700 msgr2=0x7efe900b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- 172.21.15.119:0/3647547368 shutdown_connections 2024-03-08T21:34:02.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- 172.21.15.119:0/3647547368 wait complete. 2024-03-08T21:34:02.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 Processor -- start 2024-03-08T21:34:02.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.602+0000 7efe97200640 1 -- start start 2024-03-08T21:34:02.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe9006afb0 0x7efe9009d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe900afcc0 0x7efe901e3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe90154570 con 0x7efe9006d610 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe901543f0 con 0x7efe9006afb0 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe901546f0 con 0x7efe900afcc0 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56352/0 (socket says 172.21.15.119:56352) 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 -- 172.21.15.119:0/4096597550 learned_addr learned my addr 172.21.15.119:0/4096597550 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe8fe00640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe9006afb0 0x7efe9009d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe95200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe900afcc0 0x7efe901e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 -- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe900afcc0 msgr2=0x7efe901e3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe900afcc0 0x7efe901e3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 -- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe9006afb0 msgr2=0x7efe9009d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe9006afb0 0x7efe9009d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 -- 172.21.15.119:0/4096597550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9009dd50 con 0x7efe9006d610 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe87400640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe7800d800 tx=0x7efe7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800b6c0 con 0x7efe9006d610 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78019070 con 0x7efe9006d610 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe90151130 con 0x7efe9006d610 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800bae0 con 0x7efe9006d610 2024-03-08T21:34:02.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9014bba0 con 0x7efe9006d610 2024-03-08T21:34:02.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe90067db0 con 0x7efe9006d610 2024-03-08T21:34:02.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.606+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efe7800bc80 con 0x7efe9006d610 2024-03-08T21:34:02.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.610+0000 7efe8cc00640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 0x7efe6c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:02.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.610+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe78085cc0 con 0x7efe9006d610 2024-03-08T21:34:02.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.610+0000 7efe8fe00640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 0x7efe6c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:02.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.610+0000 7efe8fe00640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 0x7efe6c069b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe800ae000 tx=0x7efe800a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:02.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.614+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7efe780569d0 con 0x7efe9006d610 2024-03-08T21:34:02.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.798+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe900716d0 con 0x7efe9006d610 2024-03-08T21:34:02.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.798+0000 7efe8cc00640 1 -- 172.21.15.119:0/4096597550 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7efe780562d0 con 0x7efe9006d610 2024-03-08T21:34:02.785 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:02.786 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:02.786 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:02.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 msgr2=0x7efe6c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 0x7efe6c069b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efe800ae000 tx=0x7efe800a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 msgr2=0x7efe901e31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe7800d800 tx=0x7efe7800dcc0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 shutdown_connections 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efe6c067660 0x7efe6c069b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efe900afcc0 0x7efe901e3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe9006d610 0x7efe901e31e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 --2- 172.21.15.119:0/4096597550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efe9006afb0 0x7efe9009d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 >> 172.21.15.119:0/4096597550 conn(0x7efe900b9700 msgr2=0x7efe90070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 shutdown_connections 2024-03-08T21:34:02.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:02.802+0000 7efe97200640 1 -- 172.21.15.119:0/4096597550 wait complete. 2024-03-08T21:34:03.007 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T21:33:48.672392+0000', 'modified': '2024-03-08T21:33:51.698510+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6835/2659497367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 2659497367}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 2659497367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-08T21:34:03.007 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T21:34:03.007 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-08T21:34:03.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.154+0000 7f8a1ba00640 1 Processor -- start 2024-03-08T21:34:03.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.154+0000 7f8a1ba00640 1 -- start start 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a1ba00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a14099ca0 0x7f8a1413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a1ba00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1409a080 con 0x7f8a1413f2c0 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a1ba00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a140b4510 con 0x7f8a1409afe0 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a1ba00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a140b4b60 con 0x7f8a14099ca0 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a14099ca0 0x7f8a1413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a14099ca0 0x7f8a1413ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56358/0 (socket says 172.21.15.119:56358) 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a0be00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8a1413f2c0 0x7f8a1409a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49308/0 (socket says 172.21.15.119:49308) 2024-03-08T21:34:03.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 -- 172.21.15.119:0/77857181 learned_addr learned my addr 172.21.15.119:0/77857181 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 -- 172.21.15.119:0/77857181 >> v1:172.21.15.160:6789/0 conn(0x7f8a1409afe0 legacy=0x7f8a140b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 -- 172.21.15.119:0/77857181 >> v1:172.21.15.119:6789/0 conn(0x7f8a1413f2c0 legacy=0x7f8a1409a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a13e00640 1 -- 172.21.15.119:0/77857181 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719111925 0 0) 0x7f8a1409a080 con 0x7f8a1413f2c0 2024-03-08T21:34:03.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.158+0000 7f8a19000640 1 -- 172.21.15.119:0/77857181 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140b47f0 con 0x7f8a14099ca0 2024-03-08T21:34:03.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a19000640 1 --2- 172.21.15.119:0/77857181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a14099ca0 0x7f8a1413ed80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009870 tx=0x7f8a0401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d320d20ed349b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a13e00640 1 -- 172.21.15.119:0/77857181 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040a9400 con 0x7f8a14099ca0 2024-03-08T21:34:03.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a13e00640 1 -- 172.21.15.119:0/77857181 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040a95a0 con 0x7f8a14099ca0 2024-03-08T21:34:03.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a13e00640 1 -- 172.21.15.119:0/77857181 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040a9970 con 0x7f8a14099ca0 2024-03-08T21:34:03.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- 172.21.15.119:0/77857181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a14099ca0 msgr2=0x7f8a1413ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/77857181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a14099ca0 0x7f8a1413ed80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009870 tx=0x7f8a0401c4e0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- 172.21.15.119:0/77857181 shutdown_connections 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/77857181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a14099ca0 0x7f8a1413ed80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- 172.21.15.119:0/77857181 >> 172.21.15.119:0/77857181 conn(0x7f8a1406c620 msgr2=0x7f8a1406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- 172.21.15.119:0/77857181 shutdown_connections 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- 172.21.15.119:0/77857181 wait complete. 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 Processor -- start 2024-03-08T21:34:03.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- start start 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a14099ca0 0x7f8a140aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a1413f2c0 0x7f8a140b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141532e0 con 0x7f8a1409afe0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14153160 con 0x7f8a1413f2c0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a1ba00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a14153460 con 0x7f8a14099ca0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.162+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56362/0 (socket says 172.21.15.119:56362) 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 -- 172.21.15.119:0/1243600697 learned_addr learned my addr 172.21.15.119:0/1243600697 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a19000640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a14099ca0 0x7f8a140aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a19a00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a1413f2c0 0x7f8a140b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 -- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a14099ca0 msgr2=0x7f8a140aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a14099ca0 0x7f8a140aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 -- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a1413f2c0 msgr2=0x7f8a140b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a1413f2c0 0x7f8a140b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 -- 172.21.15.119:0/1243600697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a141e3890 con 0x7f8a1409afe0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a0be00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0011f0 tx=0x7f89fc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a11600640 1 -- 172.21.15.119:0/1243600697 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc018070 con 0x7f8a1409afe0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a11600640 1 -- 172.21.15.119:0/1243600697 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0074e0 con 0x7f8a1409afe0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a11600640 1 -- 172.21.15.119:0/1243600697 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc004a10 con 0x7f8a1409afe0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a141e2b50 con 0x7f8a1409afe0 2024-03-08T21:34:03.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a140b19d0 con 0x7f8a1409afe0 2024-03-08T21:34:03.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.166+0000 7f8a11600640 1 -- 172.21.15.119:0/1243600697 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f89fc01b070 con 0x7f8a1409afe0 2024-03-08T21:34:03.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a11600640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 0x7f89f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a11600640 1 -- 172.21.15.119:0/1243600697 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89fc084b00 con 0x7f8a1409afe0 2024-03-08T21:34:03.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 Processor -- start 2024-03-08T21:34:03.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a19000640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 0x7f89f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- start start 2024-03-08T21:34:03.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a19000640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 0x7f89f0069b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a040ae000 tx=0x7f8a04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134b570 0x55ff91388410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff91234420 con 0x55ff9134ac50 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9119bfa0 con 0x55ff9134b570 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff91123e00 con 0x55ff9134a330 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56374/0 (socket says 172.21.15.119:56374) 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 -- 172.21.15.119:0/3463797155 learned_addr learned my addr 172.21.15.119:0/3463797155 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a19000640 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a19a00640 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134b570 0x55ff91388410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 -- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 msgr2=0x55ff9134a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 -- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134b570 msgr2=0x55ff91388410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134b570 0x55ff91388410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 -- 172.21.15.119:0/3463797155 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff91127cc0 con 0x55ff9134ac50 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a0be00640 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89fc007fd0 tx=0x7f89fc055300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f1b16fe7ac5f1e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a09600640 1 -- 172.21.15.119:0/3463797155 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0534c0 con 0x55ff9134ac50 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a09600640 1 -- 172.21.15.119:0/3463797155 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc05b050 con 0x55ff9134ac50 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a09600640 1 -- 172.21.15.119:0/3463797155 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc004bb0 con 0x55ff9134ac50 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3463797155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 msgr2=0x55ff9134b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89fc007fd0 tx=0x7f89fc055300 comp rx=0 tx=0).stop 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3463797155 shutdown_connections 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134b570 0x55ff91388410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9134b030 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3463797155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3463797155 >> 172.21.15.119:0/3463797155 conn(0x55ff9137c170 msgr2=0x55ff9137e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3463797155 shutdown_connections 2024-03-08T21:34:03.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3463797155 wait complete. 2024-03-08T21:34:03.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.170+0000 7f8a1ee47000 1 -- start start 2024-03-08T21:34:03.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 Processor -- start 2024-03-08T21:34:03.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff9137af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134b570 0x55ff9137ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff91156b00 con 0x55ff9134ac50 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff91198040 con 0x55ff9134a330 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff911a05d0 con 0x55ff9134b570 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 10 client.0 _ll_register_callbacks cb 0x55ff9113ded0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56378/0 (socket says 172.21.15.119:56378) 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 -- 172.21.15.119:0/2790855070 learned_addr learned my addr 172.21.15.119:0/2790855070 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a19000640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff9137af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a19a00640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134b570 0x55ff9137ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 -- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134b570 msgr2=0x55ff9137ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134b570 0x55ff9137ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 -- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 msgr2=0x55ff9137af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff9137af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 -- 172.21.15.119:0/2790855070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff91160380 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a19000640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff9137af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a0be00640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000f70 tx=0x7f89fc059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd5dea010bedc27 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc054610 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89fc0547b0 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89fc05b050 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89fc05b200 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 10 client.4635 fetch_fsmap learned FSMap version 8 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ff9116f830 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc05b050 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) v1 ==== 2144+0+0 (secure 0 0 0) 0x7f89fc05b3a0 con 0x55ff9134ac50 2024-03-08T21:34:03.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 10 client.4635 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 20 client.4635 populate_metadata read hostname 'smithi119' 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9137d4a0 0x55ff9137d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 4 client.4635 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 --> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff91137b60 con 0x55ff9137d4a0 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a19000640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9137d4a0 0x55ff9137d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a19000640 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9137d4a0 0x55ff9137d880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371194bfea33fb49 server_cookie=3fcc205de59239e9 in_seq=0 out_seq=0 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 10 client.4635 ms_handle_connect on v2:172.21.15.119:6834/2659497367 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 1 -- 172.21.15.119:0/2790855070 <== mds.0 v2:172.21.15.119:6834/2659497367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff91137b60 con 0x55ff9137d4a0 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.174+0000 7f8a02000640 10 client.4635 handle_command_reply: tid=0 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 client.4635 shutdown 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 msgr2=0x55ff9137c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89fc000f70 tx=0x7f89fc059040 comp rx=0 tx=0).stop 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 shutdown_connections 2024-03-08T21:34:03.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134b570 0x55ff9137ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9134ac50 0x55ff9137c550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9137d4a0 0x55ff9137d880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/2790855070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff9137af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a02000640 0 client.4635 ms_handle_reset on v2:172.21.15.119:6834/2659497367 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 >> 172.21.15.119:0/2790855070 conn(0x55ff9137c170 msgr2=0x55ff91349a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 shutdown_connections 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 1 -- 172.21.15.119:0/2790855070 wait complete. 2024-03-08T21:34:03.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.178+0000 7f8a1ee47000 20 client.4635 trim_cache size 0 max 16384 2024-03-08T21:34:03.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.190+0000 7f8a1ee47000 1 Processor -- start 2024-03-08T21:34:03.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.190+0000 7f8a1ee47000 1 -- start start 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134ac50 0x55ff9134e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141ebee0 con 0x55ff9137c170 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a141eb120 con 0x55ff9134ac50 2024-03-08T21:34:03.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff91257b80 con 0x55ff9134a330 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56384/0 (socket says 172.21.15.119:56384) 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 -- 172.21.15.119:0/3840812087 learned_addr learned my addr 172.21.15.119:0/3840812087 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 -- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 msgr2=0x55ff9134dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 -- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134ac50 msgr2=0x55ff9134e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134ac50 0x55ff9134e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 -- 172.21.15.119:0/3840812087 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff91169fb0 con 0x55ff9137c170 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19000640 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a040190f0 tx=0x7f8a04004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fd5c4043741ee0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a08c00640 1 -- 172.21.15.119:0/3840812087 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040d0030 con 0x55ff9137c170 2024-03-08T21:34:03.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a08c00640 1 -- 172.21.15.119:0/3840812087 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040cb150 con 0x55ff9137c170 2024-03-08T21:34:03.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a08c00640 1 -- 172.21.15.119:0/3840812087 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040cb300 con 0x55ff9137c170 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3840812087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 msgr2=0x55ff9134d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a040190f0 tx=0x7f8a04004740 comp rx=0 tx=0).stop 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3840812087 shutdown_connections 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134ac50 0x55ff9134e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134a330 0x55ff9134dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/3840812087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff9134d960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3840812087 >> 172.21.15.119:0/3840812087 conn(0x55ff91352ab0 msgr2=0x55ff9137af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3840812087 shutdown_connections 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- 172.21.15.119:0/3840812087 wait complete. 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- start start 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 Processor -- start 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff913bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134ac50 0x55ff913bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff91141970 con 0x55ff9137c170 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff9115f850 con 0x55ff9134a330 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff9119b2b0 con 0x55ff9134ac50 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a1ee47000 10 client.0 _ll_register_callbacks cb 0x55ff91319150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56400/0 (socket says 172.21.15.119:56400) 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.194+0000 7f8a19a00640 1 -- 172.21.15.119:0/475446497 learned_addr learned my addr 172.21.15.119:0/475446497 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a0be00640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134ac50 0x55ff913bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19000640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff913bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 -- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134ac50 msgr2=0x55ff913bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134ac50 0x55ff913bbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 -- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 msgr2=0x55ff913bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff913bb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 -- 172.21.15.119:0/475446497 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff9121d2e0 con 0x55ff9137c170 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19a00640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0136e0 tx=0x7f8a0c013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ab5ac070fc7df1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01a030 con 0x55ff9137c170 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a0c010040 con 0x55ff9137c170 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a040cb150 con 0x55ff9137c170 2024-03-08T21:34:03.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a0c026050 con 0x55ff9137c170 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 10 client.4641 fetch_fsmap learned FSMap version 8 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ff911430a0 con 0x55ff9137c170 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a040cb150 con 0x55ff9137c170 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 8) v1 ==== 2144+0+0 (secure 0 0 0) 0x7f8a0c029020 con 0x55ff9137c170 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 10 client.4641 fetch_fsmap finished waiting for FSMap version 8 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 10 client.4641 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 20 client.4641 populate_metadata read hostname 'smithi119' 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9134b570 0x55ff913f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 4 client.4641 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 --> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff911a94e0 con 0x55ff9134b570 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19000640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9134b570 0x55ff913f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a19000640 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9134b570 0x55ff913f2ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ca23bf28bc7bf1 server_cookie=6de4e8c7e74b5ac8 in_seq=0 out_seq=0 2024-03-08T21:34:03.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 10 client.4641 ms_handle_connect on v2:172.21.15.119:6834/2659497367 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 1 -- 172.21.15.119:0/475446497 <== mds.0 v2:172.21.15.119:6834/2659497367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55ff911a94e0 con 0x55ff9134b570 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 10 client.4641 handle_command_reply: tid=0 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 client.4641 shutdown 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 msgr2=0x55ff913bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0136e0 tx=0x7f8a0c013ba0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 shutdown_connections 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ff9137c170 0x55ff913bc3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55ff9134ac50 0x55ff913bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.119:6834/2659497367,v1:172.21.15.119:6835/2659497367] conn(0x55ff9134b570 0x55ff913f2ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 --2- 172.21.15.119:0/475446497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff9134a330 0x55ff913bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a02000640 0 client.4641 ms_handle_reset on v2:172.21.15.119:6834/2659497367 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 >> 172.21.15.119:0/475446497 conn(0x55ff91352ab0 msgr2=0x55ff91348a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 shutdown_connections 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 1 -- 172.21.15.119:0/475446497 wait complete. 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ee47000 20 client.4641 trim_cache size 0 max 16384 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "b59e109d-7f9b-46a7-b423-bd44b3e2407a", 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4281, 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 13.880844825, 2024-03-08T21:34:03.191 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 8, 2024-03-08T21:34:03.192 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 21, 2024-03-08T21:34:03.192 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 21, 2024-03-08T21:34:03.192 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 21.437654109 2024-03-08T21:34:03.192 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:03.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 msgr2=0x7f89f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 0x7f89f0069b20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a040ae000 tx=0x7f8a04008040 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 msgr2=0x7f8a141e3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0011f0 tx=0x7f89fc00c9b0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 shutdown_connections 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f89f0067660 0x7f89f0069b20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a1413f2c0 0x7f8a140b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a1409afe0 0x7f8a141e3350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 --2- 172.21.15.119:0/1243600697 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a14099ca0 0x7f8a140aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 >> 172.21.15.119:0/1243600697 conn(0x7f8a1406c620 msgr2=0x7f8a1413b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 shutdown_connections 2024-03-08T21:34:03.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.198+0000 7f8a1ba00640 1 -- 172.21.15.119:0/1243600697 wait complete. 2024-03-08T21:34:03.205 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-08T21:34:03.228 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-08T21:34:03.229 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-08T21:34:03.229 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-08T21:34:03.229 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T21:34:03.229 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:03.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.229 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-03-08T21:34:03.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-03-08T21:34:03.303 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2024-03-08T21:34:03.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:34:03.306 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-08T21:34:03.306 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T21:34:03.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 Processor -- start 2024-03-08T21:34:03.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 -- start start 2024-03-08T21:34:03.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f80d01448b0 0x7f80d009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d009b190 con 0x7f80d0072fe0 2024-03-08T21:34:03.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d009d240 con 0x7f80d009adb0 2024-03-08T21:34:03.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d8600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d009d520 con 0x7f80d01448b0 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d5200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f80d0072fe0 0x7f80d013d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49316/0 (socket says 172.21.15.119:49316) 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d5200640 1 -- 172.21.15.119:0/2468290534 learned_addr learned my addr 172.21.15.119:0/2468290534 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.494+0000 7f80d6600640 1 --2- 172.21.15.119:0/2468290534 >> v2:172.21.15.119:3300/0 conn(0x7f80d01448b0 0x7f80d009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d6600640 1 -- 172.21.15.119:0/2468290534 >> v1:172.21.15.160:6789/0 conn(0x7f80d009adb0 legacy=0x7f80d01441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d6600640 1 -- 172.21.15.119:0/2468290534 >> v1:172.21.15.119:6789/0 conn(0x7f80d0072fe0 legacy=0x7f80d013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d6600640 1 -- 172.21.15.119:0/2468290534 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0143c50 con 0x7f80d01448b0 2024-03-08T21:34:03.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80cfe00640 1 -- 172.21.15.119:0/2468290534 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120702247 0 0) 0x7f80d009b190 con 0x7f80d0072fe0 2024-03-08T21:34:03.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d6600640 1 --2- 172.21.15.119:0/2468290534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d009cbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009d90 tx=0x7f80c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1141f5a23dc37bd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80cfe00640 1 -- 172.21.15.119:0/2468290534 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b2070 con 0x7f80d01448b0 2024-03-08T21:34:03.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80cfe00640 1 -- 172.21.15.119:0/2468290534 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c80a5a50 con 0x7f80d01448b0 2024-03-08T21:34:03.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80cfe00640 1 -- 172.21.15.119:0/2468290534 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80a5e20 con 0x7f80d01448b0 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d8600640 1 -- 172.21.15.119:0/2468290534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 msgr2=0x7f80d009cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d8600640 1 --2- 172.21.15.119:0/2468290534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d009cbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009d90 tx=0x7f80c801c970 comp rx=0 tx=0).stop 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d8600640 1 -- 172.21.15.119:0/2468290534 shutdown_connections 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.498+0000 7f80d8600640 1 --2- 172.21.15.119:0/2468290534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d009cbf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- 172.21.15.119:0/2468290534 >> 172.21.15.119:0/2468290534 conn(0x7f80d006c620 msgr2=0x7f80d006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- 172.21.15.119:0/2468290534 shutdown_connections 2024-03-08T21:34:03.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- 172.21.15.119:0/2468290534 wait complete. 2024-03-08T21:34:03.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 Processor -- start 2024-03-08T21:34:03.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- start start 2024-03-08T21:34:03.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80d0072fe0 0x7f80d01df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80d009adb0 0x7f80d0071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0152190 con 0x7f80d01448b0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0152010 con 0x7f80d0072fe0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0152310 con 0x7f80d009adb0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56420/0 (socket says 172.21.15.119:56420) 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 -- 172.21.15.119:0/1364824875 learned_addr learned my addr 172.21.15.119:0/1364824875 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d5200640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80d009adb0 0x7f80d0071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d5c00640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80d0072fe0 0x7f80d01df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 -- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80d009adb0 msgr2=0x7f80d0071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80d009adb0 0x7f80d0071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 -- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80d0072fe0 msgr2=0x7f80d01df7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80d0072fe0 0x7f80d01df7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 -- 172.21.15.119:0/1364824875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0070390 con 0x7f80d01448b0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d6600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b0040 tx=0x7f80c8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80bd020 con 0x7f80d01448b0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c80b3040 con 0x7f80d01448b0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d0070c20 con 0x7f80d01448b0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b2050 con 0x7f80d01448b0 2024-03-08T21:34:03.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.502+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d00af430 con 0x7f80d01448b0 2024-03-08T21:34:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d00b8af0 con 0x7f80d01448b0 2024-03-08T21:34:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f80c8003bc0 con 0x7f80d01448b0 2024-03-08T21:34:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80cd600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 0x7f80b0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80c81208e0 con 0x7f80d01448b0 2024-03-08T21:34:03.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80d5c00640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 0x7f80b0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:03.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.506+0000 7f80d5c00640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 0x7f80b0069b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80c4007fd0 tx=0x7f80c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:03.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.510+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f80c80c7060 con 0x7f80d01448b0 2024-03-08T21:34:03.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.698+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80d0067db0 con 0x7f80d01448b0 2024-03-08T21:34:03.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.698+0000 7f80cd600640 1 -- 172.21.15.119:0/1364824875 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f80c8016560 con 0x7f80d01448b0 2024-03-08T21:34:03.687 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T21:34:03.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 msgr2=0x7f80b0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 0x7f80b0069b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f80c4007fd0 tx=0x7f80c4009040 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 msgr2=0x7f80d006fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b0040 tx=0x7f80c8019710 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 shutdown_connections 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80b0067690 0x7f80b0069b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80d01448b0 0x7f80d006fac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80d009adb0 0x7f80d0071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 --2- 172.21.15.119:0/1364824875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80d0072fe0 0x7f80d01df7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 >> 172.21.15.119:0/1364824875 conn(0x7f80d006c620 msgr2=0x7f80d013ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 shutdown_connections 2024-03-08T21:34:03.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:03.702+0000 7f80d8600640 1 -- 172.21.15.119:0/1364824875 wait complete. 2024-03-08T21:34:03.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T21:34:03.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T21:34:03.708 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T21:34:03.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.708 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-03-08T21:34:03.716 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-03-08T21:34:03.717 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:37:09:31:94 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-08T21:34:03.718 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:03.719 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T21:34:03.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T21:34:03.720 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:03.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.829 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T21:34:03.846 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-03-08T21:34:03.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.849 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-03-08T21:34:03.929 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:03.930 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T21:34:03.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-08T21:34:03.931 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:04.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.017 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-03-08T21:34:04.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.026 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2024-03-08T21:34:04.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.075 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:04.075 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:04.075 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:04.075 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-08T21:34:04.075 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:04.156 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-08T21:34:04.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-08T21:34:04.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-08T21:34:04.157 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:04.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.304 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:04.304 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:04.304 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-03-08T21:34:04.304 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T21:34:04.304 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:04.344 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-08T21:34:04.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T21:34:04.344 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:04.395 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-08T21:34:04.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T21:34:04.396 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:04.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-03-08T21:34:04.510 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T21:34:04.563 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T21:34:04.564 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysusers.service 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T21:34:04.565 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T21:34:04.566 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-03-08T21:34:04.566 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:04.566 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:04.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.567 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-03-08T21:34:04.618 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-08T21:34:04.618 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-08T21:34:04.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-03-08T21:34:04.685 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-03-08T21:34:04.736 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysusers.service 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T21:34:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T21:34:04.738 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T21:34:04.738 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-03-08T21:34:04.738 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:04.738 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:04.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.739 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-03-08T21:34:04.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2024-03-08T21:34:04.782+0000 7f6f59046580 -1 init, newargv = 0x5599b0eaa080 newargc=15 2024-03-08T21:34:04.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[34643]: starting ceph client 2024-03-08T21:34:04.776 INFO:teuthology.orchestra.run.smithi119.stdout:43 2024-03-08T21:34:04.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[34643]: starting fuse 2024-03-08T21:34:04.777 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-08T21:34:04.777 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2024-03-08T21:34:04.777 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-03-08T21:34:04.777 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-03-08T21:34:04.777 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-08T21:34:04.778 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2024-03-08T21:34:04.779 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-03-08T21:34:04.901 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.34643.asok 2024-03-08T21:34:04.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-08T21:34:04.913 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34643.asok 2024-03-08T21:34:04.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:04.913 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34643.asok status 2024-03-08T21:34:05.078 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "7d63482aa89628d733e298984a762389b625c761", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.0.0-1965-g7d63482a (7d63482aa89628d733e298984a762389b625c761) squid (dev)", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "34643", 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4659, 2024-03-08T21:34:05.079 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4659 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1279244129 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 1279244129 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:05.080 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4659 192.168.0.1:0/1279244129", 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/1279244129", 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 21, 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-03-08T21:34:05.081 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:05.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:05.093 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-03-08T21:34:05.093 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:05.102 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-03-08T21:34:05.102 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:05.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:05.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:05.161 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-08T21:34:05.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 Processor -- start 2024-03-08T21:34:05.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 -- start start 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bcc066d30 0x7f1bcc0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1bcc14f7c0 0x7f1bcc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc0b4630 con 0x7f1bcc143f40 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc067110 con 0x7f1bcc066d30 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bcb200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0ae5a0 con 0x7f1bcc14f7c0 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bc9e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bcc066d30 0x7f1bcc0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bc9e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bcc066d30 0x7f1bcc0b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56432/0 (socket says 172.21.15.119:56432) 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bc9e00640 1 -- 172.21.15.119:0/2386436453 learned_addr learned my addr 172.21.15.119:0/2386436453 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bca800640 1 --2- 172.21.15.119:0/2386436453 >> v2:172.21.15.160:3300/0 conn(0x7f1bcc14f7c0 0x7f1bcc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bc9e00640 1 -- 172.21.15.119:0/2386436453 >> v2:172.21.15.160:3300/0 conn(0x7f1bcc14f7c0 msgr2=0x7f1bcc151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.350+0000 7f1bc9e00640 1 --2- 172.21.15.119:0/2386436453 >> v2:172.21.15.160:3300/0 conn(0x7f1bcc14f7c0 0x7f1bcc151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc9e00640 1 -- 172.21.15.119:0/2386436453 >> v1:172.21.15.160:6789/0 conn(0x7f1bcc143f40 legacy=0x7f1bcc1443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc9e00640 1 -- 172.21.15.119:0/2386436453 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0b40a0 con 0x7f1bcc066d30 2024-03-08T21:34:05.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc9e00640 1 --2- 172.21.15.119:0/2386436453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc072810 tx=0x7f1bbc01cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb1a72633e6777f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc8a00640 1 -- 172.21.15.119:0/2386436453 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b1070 con 0x7f1bcc066d30 2024-03-08T21:34:05.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc8a00640 1 -- 172.21.15.119:0/2386436453 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0ac600 con 0x7f1bcc066d30 2024-03-08T21:34:05.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bc8a00640 1 -- 172.21.15.119:0/2386436453 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0ac9d0 con 0x7f1bcc066d30 2024-03-08T21:34:05.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 -- 172.21.15.119:0/2386436453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 msgr2=0x7f1bcc0b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 --2- 172.21.15.119:0/2386436453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc072810 tx=0x7f1bbc01cef0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 -- 172.21.15.119:0/2386436453 shutdown_connections 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 --2- 172.21.15.119:0/2386436453 >> v2:172.21.15.160:3300/0 conn(0x7f1bcc14f7c0 0x7f1bcc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 --2- 172.21.15.119:0/2386436453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b3770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 -- 172.21.15.119:0/2386436453 >> 172.21.15.119:0/2386436453 conn(0x7f1bcc0b8f40 msgr2=0x7f1bcc0b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 -- 172.21.15.119:0/2386436453 shutdown_connections 2024-03-08T21:34:05.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.354+0000 7f1bcb200640 1 -- 172.21.15.119:0/2386436453 wait complete. 2024-03-08T21:34:05.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 Processor -- start 2024-03-08T21:34:05.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- start start 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc143f40 0x7f1bcc1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 0x7f1bcc144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b52d0 con 0x7f1bcc066d30 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b5150 con 0x7f1bcc143f40 2024-03-08T21:34:05.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0afe10 con 0x7f1bcc14f7c0 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56442/0 (socket says 172.21.15.119:56442) 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 -- 172.21.15.119:0/1955306865 learned_addr learned my addr 172.21.15.119:0/1955306865 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bca800640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 0x7f1bcc144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9400640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc143f40 0x7f1bcc1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 -- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 msgr2=0x7f1bcc144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 0x7f1bcc144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 -- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc143f40 msgr2=0x7f1bcc1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc143f40 0x7f1bcc1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 -- 172.21.15.119:0/1955306865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0b0420 con 0x7f1bcc066d30 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bca800640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 0x7f1bcc144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc9e00640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc01a0c0 tx=0x7f1bbc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b1040 con 0x7f1bcc066d30 2024-03-08T21:34:05.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0bc070 con 0x7f1bcc066d30 2024-03-08T21:34:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b7850 con 0x7f1bcc066d30 2024-03-08T21:34:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc146fd0 con 0x7f1bcc066d30 2024-03-08T21:34:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.358+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc1461e0 con 0x7f1bcc066d30 2024-03-08T21:34:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc0750f0 con 0x7f1bcc066d30 2024-03-08T21:34:05.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1bbc0ac4a0 con 0x7f1bcc066d30 2024-03-08T21:34:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bc2000640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 0x7f1bac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bbc11f600 con 0x7f1bcc066d30 2024-03-08T21:34:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bc9400640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 0x7f1bac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.362+0000 7f1bc9400640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 0x7f1bac069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc1445b0 tx=0x7f1bb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.366+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1bbc0c5020 con 0x7f1bcc066d30 2024-03-08T21:34:05.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.526+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bcc0b8530 con 0x7f1bcc066d30 2024-03-08T21:34:05.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.526+0000 7f1bc2000640 1 -- 172.21.15.119:0/1955306865 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f1bbc016110 con 0x7f1bcc066d30 2024-03-08T21:34:05.515 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:05.515 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:05.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 msgr2=0x7f1bac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 0x7f1bac069b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc1445b0 tx=0x7f1bb8009040 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 msgr2=0x7f1bcc0b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc01a0c0 tx=0x7f1bbc01acd0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 shutdown_connections 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bac067660 0x7f1bac069b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bcc14f7c0 0x7f1bcc144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc143f40 0x7f1bcc1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 --2- 172.21.15.119:0/1955306865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc066d30 0x7f1bcc0b08d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 >> 172.21.15.119:0/1955306865 conn(0x7f1bcc0b8f40 msgr2=0x7f1bcc0b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 shutdown_connections 2024-03-08T21:34:05.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.530+0000 7f1bcb200640 1 -- 172.21.15.119:0/1955306865 wait complete. 2024-03-08T21:34:05.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:05.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:05.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 Processor -- start 2024-03-08T21:34:05.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 -- start start 2024-03-08T21:34:05.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc83006c840 0x7fc8300b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc830144030 0x7fc830144490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8301449d0 con 0x7fc830140fb0 2024-03-08T21:34:05.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83006cc20 con 0x7fc83006c840 2024-03-08T21:34:05.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc837000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300b3670 con 0x7fc830144030 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc835000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc830140fb0 0x7fc8301413e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49320/0 (socket says 172.21.15.119:49320) 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc835000640 1 -- 172.21.15.119:0/3689981856 learned_addr learned my addr 172.21.15.119:0/3689981856 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82fe00640 1 --2- 172.21.15.119:0/3689981856 >> v2:172.21.15.160:3300/0 conn(0x7fc83006c840 0x7fc8300b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc827400640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc830144030 0x7fc830144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82f400640 1 -- 172.21.15.119:0/3689981856 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130896843 0 0) 0x7fc8301449d0 con 0x7fc830140fb0 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82f400640 1 -- 172.21.15.119:0/3689981856 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc814003530 con 0x7fc830140fb0 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82fe00640 1 -- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc830144030 msgr2=0x7fc830144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82fe00640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc830144030 0x7fc830144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82fe00640 1 -- 172.21.15.119:0/3689981856 >> v1:172.21.15.119:6789/0 conn(0x7fc830140fb0 legacy=0x7fc8301413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.690+0000 7fc82fe00640 1 -- 172.21.15.119:0/3689981856 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300b3950 con 0x7fc83006c840 2024-03-08T21:34:05.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc82fe00640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc83006c840 0x7fc8300b3090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc830144ba0 tx=0x7fc82001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e61fd142cd66f4f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc82f400640 1 -- 172.21.15.119:0/3689981856 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200b2070 con 0x7fc83006c840 2024-03-08T21:34:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc82f400640 1 -- 172.21.15.119:0/3689981856 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8200a5780 con 0x7fc83006c840 2024-03-08T21:34:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc82f400640 1 -- 172.21.15.119:0/3689981856 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200a5b30 con 0x7fc83006c840 2024-03-08T21:34:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 -- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc83006c840 msgr2=0x7fc8300b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc83006c840 0x7fc8300b3090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc830144ba0 tx=0x7fc82001c8c0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 -- 172.21.15.119:0/3689981856 shutdown_connections 2024-03-08T21:34:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc830144030 0x7fc830144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 --2- 172.21.15.119:0/3689981856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc83006c840 0x7fc8300b3090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 -- 172.21.15.119:0/3689981856 >> 172.21.15.119:0/3689981856 conn(0x7fc83009a230 msgr2=0x7fc83009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 -- 172.21.15.119:0/3689981856 shutdown_connections 2024-03-08T21:34:05.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.694+0000 7fc837000640 1 -- 172.21.15.119:0/3689981856 wait complete. 2024-03-08T21:34:05.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 Processor -- start 2024-03-08T21:34:05.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- start start 2024-03-08T21:34:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc83006c840 0x7fc8300b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc830140fb0 0x7fc8301df840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830150de0 con 0x7fc830144030 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83006e190 con 0x7fc830140fb0 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830150f60 con 0x7fc83006c840 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56452/0 (socket says 172.21.15.119:56452) 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 -- 172.21.15.119:0/1421009708 learned_addr learned my addr 172.21.15.119:0/1421009708 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc82fe00640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc83006c840 0x7fc8300b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc827400640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc830140fb0 0x7fc8301df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 -- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc83006c840 msgr2=0x7fc8300b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc83006c840 0x7fc8300b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 -- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc830140fb0 msgr2=0x7fc8301df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc830140fb0 0x7fc8301df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 -- 172.21.15.119:0/1421009708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83013cef0 con 0x7fc830144030 2024-03-08T21:34:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc835000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c450 tx=0x7fc82800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828017070 con 0x7fc830144030 2024-03-08T21:34:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828005cf0 con 0x7fc830144030 2024-03-08T21:34:05.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280072b0 con 0x7fc830144030 2024-03-08T21:34:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83013c780 con 0x7fc830144030 2024-03-08T21:34:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83009cdb0 con 0x7fc830144030 2024-03-08T21:34:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.698+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830067db0 con 0x7fc830144030 2024-03-08T21:34:05.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.702+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc828007450 con 0x7fc830144030 2024-03-08T21:34:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.702+0000 7fc82cc00640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 0x7fc80c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.702+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc828084ac0 con 0x7fc830144030 2024-03-08T21:34:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.702+0000 7fc82fe00640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 0x7fc80c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:05.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.702+0000 7fc82fe00640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 0x7fc80c069b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8200af000 tx=0x7fc8200a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:05.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.706+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fc828007740 con 0x7fc830144030 2024-03-08T21:34:05.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.862+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8300b8260 con 0x7fc830144030 2024-03-08T21:34:05.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.862+0000 7fc82cc00640 1 -- 172.21.15.119:0/1421009708 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8280550e0 con 0x7fc830144030 2024-03-08T21:34:05.850 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 msgr2=0x7fc80c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 0x7fc80c069b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc8200af000 tx=0x7fc8200a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 msgr2=0x7fc8301dfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c450 tx=0x7fc82800c910 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 shutdown_connections 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc80c067690 0x7fc80c069b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc830144030 0x7fc8301dfd80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc830140fb0 0x7fc8301df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 --2- 172.21.15.119:0/1421009708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc83006c840 0x7fc8300b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 >> 172.21.15.119:0/1421009708 conn(0x7fc83009a230 msgr2=0x7fc83009a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 shutdown_connections 2024-03-08T21:34:05.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:05.866+0000 7fc837000640 1 -- 172.21.15.119:0/1421009708 wait complete. 2024-03-08T21:34:05.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:06.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 Processor -- start 2024-03-08T21:34:06.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 -- start start 2024-03-08T21:34:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa64c0b74c0 0x7fa64c0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0b7e60 con 0x7fa64c06c5e0 2024-03-08T21:34:06.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c0b39c0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.018+0000 7fa652200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b3ca0 con 0x7fa64c0b4420 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa64c0b74c0 0x7fa64c0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64b400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa64c0b74c0 0x7fa64c0b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:48904/0 (socket says 172.21.15.119:48904) 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 -- 172.21.15.119:0/3864161159 learned_addr learned my addr 172.21.15.119:0/3864161159 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 -- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 msgr2=0x7fa64c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 --2- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 -- 172.21.15.119:0/3864161159 >> v1:172.21.15.160:6789/0 conn(0x7fa64c06c5e0 legacy=0x7fa64c06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 -- 172.21.15.119:0/3864161159 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c06d890 con 0x7fa64c0b74c0 2024-03-08T21:34:06.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64aa00640 1 --2- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c0b74c0 0x7fa64c0b7920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa638009870 tx=0x7fa63801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab7f55aa3ba77e3e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.022+0000 7fa64a000640 1 -- 172.21.15.119:0/3864161159 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380b1070 con 0x7fa64c0b74c0 2024-03-08T21:34:06.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64a000640 1 -- 172.21.15.119:0/3864161159 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380a8050 con 0x7fa64c0b74c0 2024-03-08T21:34:06.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64a000640 1 -- 172.21.15.119:0/3864161159 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380ac860 con 0x7fa64c0b74c0 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c0b74c0 msgr2=0x7fa64c0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c0b74c0 0x7fa64c0b7920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa638009870 tx=0x7fa63801c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- 172.21.15.119:0/3864161159 shutdown_connections 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c0b74c0 0x7fa64c0b7920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- 172.21.15.119:0/3864161159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- 172.21.15.119:0/3864161159 >> 172.21.15.119:0/3864161159 conn(0x7fa64c09a230 msgr2=0x7fa64c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- 172.21.15.119:0/3864161159 shutdown_connections 2024-03-08T21:34:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- 172.21.15.119:0/3864161159 wait complete. 2024-03-08T21:34:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 Processor -- start 2024-03-08T21:34:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- start start 2024-03-08T21:34:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c06c5e0 0x7fa64c098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c154880 con 0x7fa64c0b74c0 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c154700 con 0x7fa64c06c5e0 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa652200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c154a00 con 0x7fa64c0b4420 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56464/0 (socket says 172.21.15.119:56464) 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 -- 172.21.15.119:0/3156893018 learned_addr learned my addr 172.21.15.119:0/3156893018 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64b400640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c06c5e0 0x7fa64c098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64aa00640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 -- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 msgr2=0x7fa64c143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 -- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c06c5e0 msgr2=0x7fa64c098ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c06c5e0 0x7fa64c098ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.026+0000 7fa64be00640 1 -- 172.21.15.119:0/3156893018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c14a2f0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa64be00640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c460 tx=0x7fa64400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644016020 con 0x7fa64c0b74c0 2024-03-08T21:34:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644005220 con 0x7fa64c0b74c0 2024-03-08T21:34:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644007030 con 0x7fa64c0b74c0 2024-03-08T21:34:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c143a50 con 0x7fa64c0b74c0 2024-03-08T21:34:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c1426d0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c067db0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa6440071d0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 0x7fa62c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa644085090 con 0x7fa64c0b74c0 2024-03-08T21:34:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.030+0000 7fa64b400640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 0x7fa62c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.034+0000 7fa64b400640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 0x7fa62c069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0113e0 tx=0x7fa63c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.034+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa644020020 con 0x7fa64c0b74c0 2024-03-08T21:34:06.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa64c099670 con 0x7fa64c0b74c0 2024-03-08T21:34:06.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa643400640 1 -- 172.21.15.119:0/3156893018 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6440074c0 con 0x7fa64c0b74c0 2024-03-08T21:34:06.177 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 msgr2=0x7fa62c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 0x7fa62c069b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0113e0 tx=0x7fa63c00b040 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 msgr2=0x7fa64c148df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c460 tx=0x7fa64400c920 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 shutdown_connections 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa62c067660 0x7fa62c069b20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa64c0b74c0 0x7fa64c148df0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa64c0b4420 0x7fa64c143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 --2- 172.21.15.119:0/3156893018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa64c06c5e0 0x7fa64c098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 >> 172.21.15.119:0/3156893018 conn(0x7fa64c09a230 msgr2=0x7fa64c14d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 shutdown_connections 2024-03-08T21:34:06.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.190+0000 7fa652200640 1 -- 172.21.15.119:0/3156893018 wait complete. 2024-03-08T21:34:06.198 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:06.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 Processor -- start 2024-03-08T21:34:06.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 -- start start 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a98066d30 0x7f1a980aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1a98144670 0x7f1a98151890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980ae740 con 0x7f1a980af380 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98067110 con 0x7f1a98144670 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a9d600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b4320 con 0x7f1a98066d30 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1a98144670 0x7f1a98151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1a98144670 0x7f1a98151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56474/0 (socket says 172.21.15.119:56474) 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 -- 172.21.15.119:0/3992496610 learned_addr learned my addr 172.21.15.119:0/3992496610 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a96a00640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a98066d30 0x7f1a980aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 -- 172.21.15.119:0/3992496610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a98066d30 msgr2=0x7f1a980aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a98066d30 0x7f1a980aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 -- 172.21.15.119:0/3992496610 >> v1:172.21.15.160:6789/0 conn(0x7f1a980af380 legacy=0x7f1a98143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.350+0000 7f1a97400640 1 -- 172.21.15.119:0/3992496610 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980b4c20 con 0x7f1a98144670 2024-03-08T21:34:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a97400640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98144670 0x7f1a98151890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009e50 tx=0x7f1a9001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54203a394f1d9e03 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a95600640 1 -- 172.21.15.119:0/3992496610 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900a5700 con 0x7f1a98144670 2024-03-08T21:34:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a95600640 1 -- 172.21.15.119:0/3992496610 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900a58a0 con 0x7f1a98144670 2024-03-08T21:34:06.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a95600640 1 -- 172.21.15.119:0/3992496610 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900a5c70 con 0x7f1a98144670 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- 172.21.15.119:0/3992496610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98144670 msgr2=0x7f1a98151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98144670 0x7f1a98151890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009e50 tx=0x7f1a9001ca30 comp rx=0 tx=0).stop 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- 172.21.15.119:0/3992496610 shutdown_connections 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98144670 0x7f1a98151890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 --2- 172.21.15.119:0/3992496610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a98066d30 0x7f1a980aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- 172.21.15.119:0/3992496610 >> 172.21.15.119:0/3992496610 conn(0x7f1a980b5770 msgr2=0x7f1a980b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- 172.21.15.119:0/3992496610 shutdown_connections 2024-03-08T21:34:06.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- 172.21.15.119:0/3992496610 wait complete. 2024-03-08T21:34:06.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 Processor -- start 2024-03-08T21:34:06.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.354+0000 7f1a9d600640 1 -- start start 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 0x7f1a9813bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 0x7f1a980b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980af760 con 0x7f1a98066d30 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980b47c0 con 0x7f1a98144670 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9813b6e0 con 0x7f1a980af380 2024-03-08T21:34:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56480/0 (socket says 172.21.15.119:56480) 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 -- 172.21.15.119:0/59159065 learned_addr learned my addr 172.21.15.119:0/59159065 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96000640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 0x7f1a9813bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a97400640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 0x7f1a980b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 -- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 msgr2=0x7f1a9813bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 0x7f1a9813bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 -- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 msgr2=0x7f1a980b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 0x7f1a980b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 -- 172.21.15.119:0/59159065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98071c70 con 0x7f1a98066d30 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a97400640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 0x7f1a980b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96000640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 0x7f1a9813bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a96a00640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800e870 tx=0x7f1a8800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88017070 con 0x7f1a98066d30 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800c940 con 0x7f1a98066d30 2024-03-08T21:34:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800ccf0 con 0x7f1a98066d30 2024-03-08T21:34:06.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9813cde0 con 0x7f1a98066d30 2024-03-08T21:34:06.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a980b8600 con 0x7f1a98066d30 2024-03-08T21:34:06.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a98067db0 con 0x7f1a98066d30 2024-03-08T21:34:06.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.358+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1a8801a070 con 0x7f1a98066d30 2024-03-08T21:34:06.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.362+0000 7f1a8ea00640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 0x7f1a78069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.362+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a88085b30 con 0x7f1a98066d30 2024-03-08T21:34:06.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.362+0000 7f1a96000640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 0x7f1a78069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.362+0000 7f1a96000640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 0x7f1a78069b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a98145030 tx=0x7f1a84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.366+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1a880567a0 con 0x7f1a98066d30 2024-03-08T21:34:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a98071e40 con 0x7f1a98066d30 2024-03-08T21:34:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a8ea00640 1 -- 172.21.15.119:0/59159065 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a880560a0 con 0x7f1a98066d30 2024-03-08T21:34:06.508 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 msgr2=0x7f1a78069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 0x7f1a78069b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a98145030 tx=0x7f1a84009040 comp rx=0 tx=0).stop 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 msgr2=0x7f1a981df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800e870 tx=0x7f1a8800ec70 comp rx=0 tx=0).stop 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 shutdown_connections 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1a78067660 0x7f1a78069b20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a98144670 0x7f1a980b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a980af380 0x7f1a9813bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 --2- 172.21.15.119:0/59159065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a98066d30 0x7f1a981df4d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 >> 172.21.15.119:0/59159065 conn(0x7f1a980b5770 msgr2=0x7f1a980b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 shutdown_connections 2024-03-08T21:34:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.522+0000 7f1a9d600640 1 -- 172.21.15.119:0/59159065 wait complete. 2024-03-08T21:34:06.529 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:06.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.674+0000 7f3d63800640 1 Processor -- start 2024-03-08T21:34:06.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.674+0000 7f3d63800640 1 -- start start 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d63800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d5c0b5210 0x7f3d5c147a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d63800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d63800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0b55f0 con 0x7f3d5c0b5a10 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d63800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b3250 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d63800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b3480 con 0x7f3d5c0b5210 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56494/0 (socket says 172.21.15.119:56494) 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 -- 172.21.15.119:0/1214175483 learned_addr learned my addr 172.21.15.119:0/1214175483 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d60e00640 1 --2- 172.21.15.119:0/1214175483 >> v2:172.21.15.160:3300/0 conn(0x7f3d5c0b5210 0x7f3d5c147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 -- 172.21.15.119:0/1214175483 >> v2:172.21.15.160:3300/0 conn(0x7f3d5c0b5210 msgr2=0x7f3d5c147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:06.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 --2- 172.21.15.119:0/1214175483 >> v2:172.21.15.160:3300/0 conn(0x7f3d5c0b5210 0x7f3d5c147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 -- 172.21.15.119:0/1214175483 >> v1:172.21.15.160:6789/0 conn(0x7f3d5c0b5a10 legacy=0x7f3d5c14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 -- 172.21.15.119:0/1214175483 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c147250 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.678+0000 7f3d5be00640 1 --2- 172.21.15.119:0/1214175483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06f230 tx=0x7f3d4801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4ab0e1e61d3330 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5b400640 1 -- 172.21.15.119:0/1214175483 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b1070 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5b400640 1 -- 172.21.15.119:0/1214175483 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480ac640 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5b400640 1 -- 172.21.15.119:0/1214175483 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480aca10 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- 172.21.15.119:0/1214175483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b3c40 msgr2=0x7f3d5c09cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- 172.21.15.119:0/1214175483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c06f230 tx=0x7f3d4801c400 comp rx=0 tx=0).stop 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- 172.21.15.119:0/1214175483 shutdown_connections 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- 172.21.15.119:0/1214175483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b3c40 0x7f3d5c09cdc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- 172.21.15.119:0/1214175483 >> v2:172.21.15.160:3300/0 conn(0x7f3d5c0b5210 0x7f3d5c147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- 172.21.15.119:0/1214175483 >> 172.21.15.119:0/1214175483 conn(0x7f3d5c06c620 msgr2=0x7f3d5c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- 172.21.15.119:0/1214175483 shutdown_connections 2024-03-08T21:34:06.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- 172.21.15.119:0/1214175483 wait complete. 2024-03-08T21:34:06.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 Processor -- start 2024-03-08T21:34:06.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- start start 2024-03-08T21:34:06.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 0x7f3d5c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d5c0b5a10 0x7f3d5c1e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c099bc0 con 0x7f3d5c0b5210 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c099a40 con 0x7f3d5c0b5a10 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d63800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c154a00 con 0x7f3d5c0b3c40 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56504/0 (socket says 172.21.15.119:56504) 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 -- 172.21.15.119:0/2648013107 learned_addr learned my addr 172.21.15.119:0/2648013107 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d60e00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 0x7f3d5c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 -- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 msgr2=0x7f3d5c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 0x7f3d5c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 -- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d5c0b5a10 msgr2=0x7f3d5c1e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d5c0b5a10 0x7f3d5c1e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d5be00640 1 -- 172.21.15.119:0/2648013107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c070e50 con 0x7f3d5c0b5210 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.682+0000 7f3d60e00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 0x7f3d5c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d5be00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d480af040 tx=0x7f3d480191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b1040 con 0x7f3d5c0b5210 2024-03-08T21:34:06.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d480ba070 con 0x7f3d5c0b5210 2024-03-08T21:34:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c13e560 con 0x7f3d5c0b5210 2024-03-08T21:34:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480b56a0 con 0x7f3d5c0b5210 2024-03-08T21:34:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c06fab0 con 0x7f3d5c0b5210 2024-03-08T21:34:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c067db0 con 0x7f3d5c0b5210 2024-03-08T21:34:06.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3d480b5840 con 0x7f3d5c0b5210 2024-03-08T21:34:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 0x7f3d3c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d4811f520 con 0x7f3d5c0b5210 2024-03-08T21:34:06.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.686+0000 7f3d60e00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 0x7f3d3c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.690+0000 7f3d60e00640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 0x7f3d3c069b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c007a70 tx=0x7f3d4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.690+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f3d48016110 con 0x7f3d5c0b5210 2024-03-08T21:34:06.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.846+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d5c1dfa90 con 0x7f3d5c0b5210 2024-03-08T21:34:06.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d58c00640 1 -- 172.21.15.119:0/2648013107 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f3d480f0190 con 0x7f3d5c0b5210 2024-03-08T21:34:06.835 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:06.835 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 msgr2=0x7f3d3c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 0x7f3d3c069b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c007a70 tx=0x7f3d4c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 msgr2=0x7f3d5c1dfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d480af040 tx=0x7f3d480191a0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 shutdown_connections 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3d3c067690 0x7f3d3c069b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d5c0b5a10 0x7f3d5c1e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5c0b5210 0x7f3d5c1dfdf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 --2- 172.21.15.119:0/2648013107 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d5c0b3c40 0x7f3d5c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 >> 172.21.15.119:0/2648013107 conn(0x7f3d5c06c620 msgr2=0x7f3d5c099d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 shutdown_connections 2024-03-08T21:34:06.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:06.850+0000 7f3d63800640 1 -- 172.21.15.119:0/2648013107 wait complete. 2024-03-08T21:34:06.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:06.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 Processor -- start 2024-03-08T21:34:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 -- start start 2024-03-08T21:34:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb5ec0b42b0 0x7fb5ec06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5ec0b4690 0x7fb5ec1483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec1456a0 con 0x7fb5ec0b4690 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b3850 con 0x7fb5ec0b42b0 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f3e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec06e0b0 con 0x7fb5ec145b30 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5ec0b4690 0x7fb5ec1483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5ec0b4690 0x7fb5ec1483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56510/0 (socket says 172.21.15.119:56510) 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 -- 172.21.15.119:0/3736709707 learned_addr learned my addr 172.21.15.119:0/3736709707 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f0a00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1400640 1 --2- 172.21.15.119:0/3736709707 >> v2:172.21.15.160:3300/0 conn(0x7fb5ec0b42b0 0x7fb5ec06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 -- 172.21.15.119:0/3736709707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 msgr2=0x7fb5ec142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 -- 172.21.15.119:0/3736709707 >> v2:172.21.15.160:3300/0 conn(0x7fb5ec0b42b0 msgr2=0x7fb5ec06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:06.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 --2- 172.21.15.119:0/3736709707 >> v2:172.21.15.160:3300/0 conn(0x7fb5ec0b42b0 0x7fb5ec06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.006+0000 7fb5f1e00640 1 -- 172.21.15.119:0/3736709707 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec145050 con 0x7fb5ec0b4690 2024-03-08T21:34:06.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f1e00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec1483b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec06eb90 tx=0x7fb5e401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a36a42ac9e0ab3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:06.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5ebe00640 1 -- 172.21.15.119:0/3736709707 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a56d0 con 0x7fb5ec0b4690 2024-03-08T21:34:06.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5ebe00640 1 -- 172.21.15.119:0/3736709707 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e40a5870 con 0x7fb5ec0b4690 2024-03-08T21:34:06.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5ebe00640 1 -- 172.21.15.119:0/3736709707 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40a5c40 con 0x7fb5ec0b4690 2024-03-08T21:34:06.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 -- 172.21.15.119:0/3736709707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b4690 msgr2=0x7fb5ec1483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec1483b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec06eb90 tx=0x7fb5e401c960 comp rx=0 tx=0).stop 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 -- 172.21.15.119:0/3736709707 shutdown_connections 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec1483b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/3736709707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/3736709707 >> v2:172.21.15.160:3300/0 conn(0x7fb5ec0b42b0 0x7fb5ec06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 -- 172.21.15.119:0/3736709707 >> 172.21.15.119:0/3736709707 conn(0x7fb5ec09a230 msgr2=0x7fb5ec09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 -- 172.21.15.119:0/3736709707 shutdown_connections 2024-03-08T21:34:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.010+0000 7fb5f3e00640 1 -- 172.21.15.119:0/3736709707 wait complete. 2024-03-08T21:34:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 Processor -- start 2024-03-08T21:34:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- start start 2024-03-08T21:34:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec099600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec151870 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1516f0 con 0x7fb5ec0b4690 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1519f0 con 0x7fb5ec145b30 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56514/0 (socket says 172.21.15.119:56514) 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 -- 172.21.15.119:0/183288782 learned_addr learned my addr 172.21.15.119:0/183288782 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f0a00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 -- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 msgr2=0x7fb5ec099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 -- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ec0b4690 msgr2=0x7fb5ec099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 -- 172.21.15.119:0/183288782 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec13b650 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f1400640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000e8e0 tx=0x7fb5e000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0017070 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e000ca00 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000cdd0 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec13b930 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.014+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec147c70 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec067db0 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb5e001a070 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5e9600640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 0x7fb5cc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5e0085ba0 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5f0a00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 0x7fb5cc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.018+0000 7fb5f0a00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 0x7fb5cc069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec072b70 tx=0x7fb5d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.022+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb5e0056260 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5ec09da10 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5e9600640 1 -- 172.21.15.119:0/183288782 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5e005a300 con 0x7fb5ec0b42b0 2024-03-08T21:34:07.164 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 msgr2=0x7fb5cc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 0x7fb5cc069b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec072b70 tx=0x7fb5d8009190 comp rx=0 tx=0).stop 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 msgr2=0x7fb5ec13fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000e8e0 tx=0x7fb5e000eda0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 shutdown_connections 2024-03-08T21:34:07.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb5cc067660 0x7fb5cc069b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ec145b30 0x7fb5ec099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ec0b4690 0x7fb5ec099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 --2- 172.21.15.119:0/183288782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ec0b42b0 0x7fb5ec13fcc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 >> 172.21.15.119:0/183288782 conn(0x7fb5ec09a230 msgr2=0x7fb5ec073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 shutdown_connections 2024-03-08T21:34:07.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.178+0000 7fb5f3e00640 1 -- 172.21.15.119:0/183288782 wait complete. 2024-03-08T21:34:07.184 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 Processor -- start 2024-03-08T21:34:07.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 -- start start 2024-03-08T21:34:07.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feebc145b30 0x7feebc142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feebc0b4690 0x7feebc14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc06e0b0 con 0x7feebc0b42b0 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc1456a0 con 0x7feebc0b4690 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feec0e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc0b3850 con 0x7feebc145b30 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeb9e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7feebc0b42b0 0x7feebc06c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49330/0 (socket says 172.21.15.119:49330) 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeb9e00640 1 -- 172.21.15.119:0/1767147592 learned_addr learned my addr 172.21.15.119:0/1767147592 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeba800640 1 --2- 172.21.15.119:0/1767147592 >> v2:172.21.15.119:3300/0 conn(0x7feebc0b4690 0x7feebc14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeb9400640 1 --2- 172.21.15.119:0/1767147592 >> v2:172.21.15.160:3300/0 conn(0x7feebc145b30 0x7feebc142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeb8a00640 1 -- 172.21.15.119:0/1767147592 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654943507 0 0) 0x7feebc06e0b0 con 0x7feebc0b42b0 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeb8a00640 1 -- 172.21.15.119:0/1767147592 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea0003530 con 0x7feebc0b42b0 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeba800640 1 -- 172.21.15.119:0/1767147592 >> v2:172.21.15.160:3300/0 conn(0x7feebc145b30 msgr2=0x7feebc142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeba800640 1 --2- 172.21.15.119:0/1767147592 >> v2:172.21.15.160:3300/0 conn(0x7feebc145b30 0x7feebc142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeba800640 1 -- 172.21.15.119:0/1767147592 >> v1:172.21.15.119:6789/0 conn(0x7feebc0b42b0 legacy=0x7feebc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.334+0000 7feeba800640 1 -- 172.21.15.119:0/1767147592 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc145050 con 0x7feebc0b4690 2024-03-08T21:34:07.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feeba800640 1 --2- 172.21.15.119:0/1767147592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc14f6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feebc067280 tx=0x7feeb401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f4f33cf347f2bc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feeb8a00640 1 -- 172.21.15.119:0/1767147592 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40b2070 con 0x7feebc0b4690 2024-03-08T21:34:07.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feeb8a00640 1 -- 172.21.15.119:0/1767147592 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40a5870 con 0x7feebc0b4690 2024-03-08T21:34:07.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feeb8a00640 1 -- 172.21.15.119:0/1767147592 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40a5c40 con 0x7feebc0b4690 2024-03-08T21:34:07.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 -- 172.21.15.119:0/1767147592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 msgr2=0x7feebc14f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 --2- 172.21.15.119:0/1767147592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc14f6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feebc067280 tx=0x7feeb401c8a0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 -- 172.21.15.119:0/1767147592 shutdown_connections 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 --2- 172.21.15.119:0/1767147592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc14f6e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 --2- 172.21.15.119:0/1767147592 >> v2:172.21.15.160:3300/0 conn(0x7feebc145b30 0x7feebc142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 -- 172.21.15.119:0/1767147592 >> 172.21.15.119:0/1767147592 conn(0x7feebc09a230 msgr2=0x7feebc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 -- 172.21.15.119:0/1767147592 shutdown_connections 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.338+0000 7feec0e00640 1 -- 172.21.15.119:0/1767147592 wait complete. 2024-03-08T21:34:07.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 Processor -- start 2024-03-08T21:34:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- start start 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feebc0b42b0 0x7feebc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feebc145b30 0x7feebc0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1527d0 con 0x7feebc0b4690 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc152650 con 0x7feebc0b42b0 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc152950 con 0x7feebc145b30 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56530/0 (socket says 172.21.15.119:56530) 2024-03-08T21:34:07.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 -- 172.21.15.119:0/2856367715 learned_addr learned my addr 172.21.15.119:0/2856367715 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feebc0b42b0 0x7feebc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeba800640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feebc145b30 0x7feebc0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 -- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feebc145b30 msgr2=0x7feebc0990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feebc145b30 0x7feebc0990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 -- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feebc0b42b0 msgr2=0x7feebc06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feebc0b42b0 0x7feebc06d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 -- 172.21.15.119:0/2856367715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc06ffe0 con 0x7feebc0b4690 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb9400640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feea800e900 tx=0x7feea800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8017070 con 0x7feebc0b4690 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800ca00 con 0x7feebc0b4690 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800cdf0 con 0x7feebc0b4690 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc1e32c0 con 0x7feebc0b4690 2024-03-08T21:34:07.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.342+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc0716c0 con 0x7feebc0b4690 2024-03-08T21:34:07.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc067db0 con 0x7feebc0b4690 2024-03-08T21:34:07.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7feea801a070 con 0x7feebc0b4690 2024-03-08T21:34:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feeb2000640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 0x7fee9c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea8085bb0 con 0x7feebc0b4690 2024-03-08T21:34:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feeb9e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 0x7fee9c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.346+0000 7feeb9e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 0x7fee9c069b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeac007fd0 tx=0x7feeac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.350+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7feea80561d0 con 0x7feebc0b4690 2024-03-08T21:34:07.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feebc0684c0 con 0x7feebc0b4690 2024-03-08T21:34:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feeb2000640 1 -- 172.21.15.119:0/2856367715 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7feea805a270 con 0x7feebc0b4690 2024-03-08T21:34:07.493 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 msgr2=0x7fee9c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 0x7fee9c069b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeac007fd0 tx=0x7feeac009040 comp rx=0 tx=0).stop 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 msgr2=0x7feebc1e3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feea800e900 tx=0x7feea800edc0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 shutdown_connections 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fee9c067690 0x7fee9c069b50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feebc145b30 0x7feebc0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feebc0b4690 0x7feebc1e3ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 --2- 172.21.15.119:0/2856367715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feebc0b42b0 0x7feebc06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.506+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 >> 172.21.15.119:0/2856367715 conn(0x7feebc09a230 msgr2=0x7feebc0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.510+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 shutdown_connections 2024-03-08T21:34:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.510+0000 7feec0e00640 1 -- 172.21.15.119:0/2856367715 wait complete. 2024-03-08T21:34:07.513 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:07.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.662+0000 7fa806a00640 1 Processor -- start 2024-03-08T21:34:07.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.662+0000 7fa806a00640 1 -- start start 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8000b3c30 0x7fa8000b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 0x7fa80006c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 0x7fa800148350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b54a0 con 0x7fa8000b3c30 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b4e50 con 0x7fa80006c990 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b5130 con 0x7fa8000b2d80 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8000b3c30 0x7fa8000b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8000b3c30 0x7fa8000b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56534/0 (socket says 172.21.15.119:56534) 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 -- 172.21.15.119:0/1308814767 learned_addr learned my addr 172.21.15.119:0/1308814767 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 -- 172.21.15.119:0/1308814767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 msgr2=0x7fa80006c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:07.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa804c00640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 0x7fa80006c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806000640 1 --2- 172.21.15.119:0/1308814767 >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 0x7fa800148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 0x7fa80006c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 -- 172.21.15.119:0/1308814767 >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 msgr2=0x7fa800148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 --2- 172.21.15.119:0/1308814767 >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 0x7fa800148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 -- 172.21.15.119:0/1308814767 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000b31e0 con 0x7fa8000b3c30 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa804c00640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 0x7fa80006c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:07.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa806000640 1 --2- 172.21.15.119:0/1308814767 >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 0x7fa800148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.666+0000 7fa805600640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8000b3c30 0x7fa8000b4010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa80009da60 tx=0x7fa7f401c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5212d0d4da4eb75b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa7ffe00640 1 -- 172.21.15.119:0/1308814767 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40b0070 con 0x7fa8000b3c30 2024-03-08T21:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa7ffe00640 1 -- 172.21.15.119:0/1308814767 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f40ab600 con 0x7fa8000b3c30 2024-03-08T21:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa7ffe00640 1 -- 172.21.15.119:0/1308814767 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40ab9d0 con 0x7fa8000b3c30 2024-03-08T21:34:07.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- 172.21.15.119:0/1308814767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8000b3c30 msgr2=0x7fa8000b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8000b3c30 0x7fa8000b4010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa80009da60 tx=0x7fa7f401c140 comp rx=0 tx=0).stop 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- 172.21.15.119:0/1308814767 shutdown_connections 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- 172.21.15.119:0/1308814767 >> v2:172.21.15.160:3300/0 conn(0x7fa80006c990 0x7fa800148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b2d80 0x7fa80006c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- 172.21.15.119:0/1308814767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8000b3c30 0x7fa8000b4010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- 172.21.15.119:0/1308814767 >> 172.21.15.119:0/1308814767 conn(0x7fa8000b8380 msgr2=0x7fa8000b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- 172.21.15.119:0/1308814767 shutdown_connections 2024-03-08T21:34:07.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- 172.21.15.119:0/1308814767 wait complete. 2024-03-08T21:34:07.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 Processor -- start 2024-03-08T21:34:07.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- start start 2024-03-08T21:34:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8000b2d80 0x7fa800147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b3c30 0x7fa8001461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800145d50 con 0x7fa80006c990 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800145bd0 con 0x7fa8000b2d80 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800145ed0 con 0x7fa8000b3c30 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56544/0 (socket says 172.21.15.119:56544) 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 -- 172.21.15.119:0/957426332 learned_addr learned my addr 172.21.15.119:0/957426332 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa804c00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8000b2d80 0x7fa800147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa806000640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b3c30 0x7fa8001461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 -- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b3c30 msgr2=0x7fa8001461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b3c30 0x7fa8001461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 -- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8000b2d80 msgr2=0x7fa800147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8000b2d80 0x7fa800147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.670+0000 7fa805600640 1 -- 172.21.15.119:0/957426332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80013c6a0 con 0x7fa80006c990 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa805600640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7f401a7f0 tx=0x7fa7f4018ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40b0040 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f40b9070 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80013c980 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40aa8e0 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8001e3860 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800067db0 con 0x7fa80006c990 2024-03-08T21:34:07.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa7f40aaa80 con 0x7fa80006c990 2024-03-08T21:34:07.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 0x7fa7e0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7f411f950 con 0x7fa80006c990 2024-03-08T21:34:07.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.674+0000 7fa804c00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 0x7fa7e0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.678+0000 7fa804c00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 0x7fa7e0069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec006fd0 tx=0x7fa7ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.678+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa7f4016110 con 0x7fa80006c990 2024-03-08T21:34:07.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.834+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa80009bc20 con 0x7fa80006c990 2024-03-08T21:34:07.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.834+0000 7fa7fd600640 1 -- 172.21.15.119:0/957426332 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7f40f05c0 con 0x7fa80006c990 2024-03-08T21:34:07.822 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 msgr2=0x7fa7e0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 0x7fa7e0069b20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec006fd0 tx=0x7fa7ec008040 comp rx=0 tx=0).stop 2024-03-08T21:34:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 msgr2=0x7fa8000b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7f401a7f0 tx=0x7fa7f4018ee0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 shutdown_connections 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa7e0067660 0x7fa7e0069b20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8000b3c30 0x7fa8001461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8000b2d80 0x7fa800147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 --2- 172.21.15.119:0/957426332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa80006c990 0x7fa8000b7900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 >> 172.21.15.119:0/957426332 conn(0x7fa8000b8380 msgr2=0x7fa80009a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 shutdown_connections 2024-03-08T21:34:07.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.838+0000 7fa806a00640 1 -- 172.21.15.119:0/957426332 wait complete. 2024-03-08T21:34:07.843 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:07.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 Processor -- start 2024-03-08T21:34:07.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 -- start start 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 0x7f051409ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05140b1d30 0x7f05140b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140b2680 con 0x7f0514099ca0 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140b4b60 con 0x7f05140b1d30 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0519e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051409a080 con 0x7f051409a8d0 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0513400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05140b1d30 0x7f05140b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0512a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0514099ca0 0x7f051413ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49346/0 (socket says 172.21.15.119:49346) 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0512a00640 1 -- 172.21.15.119:0/1762240098 learned_addr learned my addr 172.21.15.119:0/1762240098 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0512000640 1 --2- 172.21.15.119:0/1762240098 >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 0x7f051409ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0513400640 1 -- 172.21.15.119:0/1762240098 >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 msgr2=0x7f051409ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0513400640 1 --2- 172.21.15.119:0/1762240098 >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 0x7f051409ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0513400640 1 -- 172.21.15.119:0/1762240098 >> v1:172.21.15.119:6789/0 conn(0x7f0514099ca0 legacy=0x7f051413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0513400640 1 -- 172.21.15.119:0/1762240098 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140b4510 con 0x7f05140b1d30 2024-03-08T21:34:07.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.990+0000 7f0512000640 1 --2- 172.21.15.119:0/1762240098 >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 0x7f051409ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:07.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0513400640 1 --2- 172.21.15.119:0/1762240098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05140b1d30 0x7f05140b2140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f051409a330 tx=0x7f050c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f6e2913d4e459d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0511600640 1 -- 172.21.15.119:0/1762240098 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0b2070 con 0x7f05140b1d30 2024-03-08T21:34:07.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0511600640 1 -- 172.21.15.119:0/1762240098 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0a5900 con 0x7f05140b1d30 2024-03-08T21:34:07.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0511600640 1 -- 172.21.15.119:0/1762240098 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0a5cd0 con 0x7f05140b1d30 2024-03-08T21:34:07.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 -- 172.21.15.119:0/1762240098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05140b1d30 msgr2=0x7f05140b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 --2- 172.21.15.119:0/1762240098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05140b1d30 0x7f05140b2140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f051409a330 tx=0x7f050c01c930 comp rx=0 tx=0).stop 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 -- 172.21.15.119:0/1762240098 shutdown_connections 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 --2- 172.21.15.119:0/1762240098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05140b1d30 0x7f05140b2140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 --2- 172.21.15.119:0/1762240098 >> v2:172.21.15.160:3300/0 conn(0x7f051409a8d0 0x7f051409ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 -- 172.21.15.119:0/1762240098 >> 172.21.15.119:0/1762240098 conn(0x7f051406c620 msgr2=0x7f051406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 -- 172.21.15.119:0/1762240098 shutdown_connections 2024-03-08T21:34:07.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.994+0000 7f0519e00640 1 -- 172.21.15.119:0/1762240098 wait complete. 2024-03-08T21:34:07.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 Processor -- start 2024-03-08T21:34:07.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- start start 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 0x7f051409b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 0x7f051413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141522d0 con 0x7f051409a8d0 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514152150 con 0x7f0514099ca0 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0514152450 con 0x7f05140b1d30 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56562/0 (socket says 172.21.15.119:56562) 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 -- 172.21.15.119:0/978871191 learned_addr learned my addr 172.21.15.119:0/978871191 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:07.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512a00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 0x7f051409b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0513400640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 0x7f051413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 -- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 msgr2=0x7f051413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 0x7f051413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 -- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 msgr2=0x7f051409b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 0x7f051409b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 -- 172.21.15.119:0/978871191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051409cd60 con 0x7f051409a8d0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512a00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 0x7f051409b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0513400640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 0x7f051413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0512000640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e810 tx=0x7f04fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc017070 con 0x7f051409a8d0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc00c8d0 con 0x7f051409a8d0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00f040 con 0x7f051409a8d0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0514072b50 con 0x7f051409a8d0 2024-03-08T21:34:07.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051409ca40 con 0x7f051409a8d0 2024-03-08T21:34:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0514067db0 con 0x7f051409a8d0 2024-03-08T21:34:07.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:07.998+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f04fc01a070 con 0x7f051409a8d0 2024-03-08T21:34:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.002+0000 7f050b400640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 0x7f04f0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.002+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04fc085490 con 0x7f051409a8d0 2024-03-08T21:34:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.002+0000 7f0512a00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 0x7f04f0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:07.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.002+0000 7f0512a00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 0x7f04f0069b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0504000f70 tx=0x7f0504009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:07.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.006+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f04fc056100 con 0x7f051409a8d0 2024-03-08T21:34:08.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.158+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05140b3920 con 0x7f051409a8d0 2024-03-08T21:34:08.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f050b400640 1 -- 172.21.15.119:0/978871191 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f04fc055a00 con 0x7f051409a8d0 2024-03-08T21:34:08.148 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:08.148 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 msgr2=0x7f04f0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 0x7f04f0069b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0504000f70 tx=0x7f0504009040 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 msgr2=0x7f051409c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e810 tx=0x7f04fc00ecd0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 shutdown_connections 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f04f0067690 0x7f04f0069b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05140b1d30 0x7f051413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f051409a8d0 0x7f051409c330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 --2- 172.21.15.119:0/978871191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0514099ca0 0x7f051409b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 >> 172.21.15.119:0/978871191 conn(0x7f051406c620 msgr2=0x7f051406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 shutdown_connections 2024-03-08T21:34:08.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.162+0000 7f0519e00640 1 -- 172.21.15.119:0/978871191 wait complete. 2024-03-08T21:34:08.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:08.168 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:08.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 Processor -- start 2024-03-08T21:34:08.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 -- start start 2024-03-08T21:34:08.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd89c0723b0 0x7fd89c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd89c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0704d0 con 0x7fd89c06fc00 2024-03-08T21:34:08.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c147c40 con 0x7fd89c0723b0 2024-03-08T21:34:08.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd8a2600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c071950 con 0x7fd89c070060 2024-03-08T21:34:08.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd892a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd89c06fc00 0x7fd89c0b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49354/0 (socket says 172.21.15.119:49354) 2024-03-08T21:34:08.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd892a00640 1 -- 172.21.15.119:0/3264070011 learned_addr learned my addr 172.21.15.119:0/3264070011 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:08.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd89b400640 1 --2- 172.21.15.119:0/3264070011 >> v2:172.21.15.160:3300/0 conn(0x7fd89c0723b0 0x7fd89c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.318+0000 7fd89be00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd89c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724990271 0 0) 0x7fd89c0704d0 con 0x7fd89c06fc00 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd880003530 con 0x7fd89c06fc00 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3415688438 0 0) 0x7fd880003530 con 0x7fd89c06fc00 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 msgr2=0x7fd89c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd89c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 >> v2:172.21.15.160:3300/0 conn(0x7fd89c0723b0 msgr2=0x7fd89c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 --2- 172.21.15.119:0/3264070011 >> v2:172.21.15.160:3300/0 conn(0x7fd89c0723b0 0x7fd89c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0b81c0 con 0x7fd89c06fc00 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fd884001680 con 0x7fd89c06fc00 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 >> v1:172.21.15.119:6789/0 conn(0x7fd89c06fc00 legacy=0x7fd89c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8800039c0 0x7fd880003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd880004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd880004d50 0x7fd8800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c147c40 con 0x7fd880004d50 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c071950 con 0x7fd8800039c0 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88000b9d0 con 0x7fd89c070060 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd880004d50 0x7fd8800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89b400640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8800039c0 0x7fd880003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd892a00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd880004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 -- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 msgr2=0x7fd880004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd89c070060 0x7fd880004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 -- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8800039c0 msgr2=0x7fd880003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd8800039c0 0x7fd880003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.322+0000 7fd89be00640 1 -- 172.21.15.119:0/3264070011 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd880003530 con 0x7fd880004d50 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89be00640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd880004d50 0x7fd8800051d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ae0 tx=0x7fd89401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978dbb5ed5dc2d76 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940b1070 con 0x7fd880004d50 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8940a4bc0 con 0x7fd880004d50 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89aa00640 1 -- 172.21.15.119:0/3264070011 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8940096b0 con 0x7fd880004d50 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- 172.21.15.119:0/3264070011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd880004d50 msgr2=0x7fd8800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 --2- 172.21.15.119:0/3264070011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd880004d50 0x7fd8800051d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd894009ae0 tx=0x7fd89401c720 comp rx=0 tx=0).stop 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89be00640 1 -- 172.21.15.119:0/3264070011 reap_dead start 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- 172.21.15.119:0/3264070011 shutdown_connections 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- 172.21.15.119:0/3264070011 >> 172.21.15.119:0/3264070011 conn(0x7fd89c0b66c0 msgr2=0x7fd89c0b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- 172.21.15.119:0/3264070011 shutdown_connections 2024-03-08T21:34:08.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- 172.21.15.119:0/3264070011 wait complete. 2024-03-08T21:34:08.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 Processor -- start 2024-03-08T21:34:08.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- start start 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd880004d50 0x7fd89c13eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 0x7fd89c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0b2ad0 con 0x7fd89c0adf80 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0b2950 con 0x7fd89c0ae400 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd8a2600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c14fd10 con 0x7fd880004d50 2024-03-08T21:34:08.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56582/0 (socket says 172.21.15.119:56582) 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 -- 172.21.15.119:0/1659462475 learned_addr learned my addr 172.21.15.119:0/1659462475 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89b400640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd880004d50 0x7fd89c13eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89be00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 0x7fd89c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 -- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd880004d50 msgr2=0x7fd89c13eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd880004d50 0x7fd89c13eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 -- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 msgr2=0x7fd89c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 0x7fd89c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd892a00640 1 -- 172.21.15.119:0/1659462475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0adaf0 con 0x7fd89c0adf80 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.326+0000 7fd89be00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 0x7fd89c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd892a00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8840017f0 tx=0x7fd8840129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88401c070 con 0x7fd89c0adf80 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884014810 con 0x7fd89c0adf80 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884014c00 con 0x7fd89c0adf80 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c1e0330 con 0x7fd89c0adf80 2024-03-08T21:34:08.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c1e08f0 con 0x7fd89c0adf80 2024-03-08T21:34:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c067db0 con 0x7fd89c0adf80 2024-03-08T21:34:08.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd88401f070 con 0x7fd89c0adf80 2024-03-08T21:34:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 0x7fd878069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd884088270 con 0x7fd89c0adf80 2024-03-08T21:34:08.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.330+0000 7fd89b400640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 0x7fd878069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.334+0000 7fd89b400640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 0x7fd878069b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd88c014510 tx=0x7fd88c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.334+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd884058a10 con 0x7fd89c0adf80 2024-03-08T21:34:08.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.494+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd89c0ad810 con 0x7fd89c0adf80 2024-03-08T21:34:08.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.494+0000 7fd893e00640 1 -- 172.21.15.119:0/1659462475 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd88405cab0 con 0x7fd89c0adf80 2024-03-08T21:34:08.482 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:08.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 msgr2=0x7fd878069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 0x7fd878069b70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd88c014510 tx=0x7fd88c00b040 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 msgr2=0x7fd89c13dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8840017f0 tx=0x7fd8840129a0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 shutdown_connections 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd8780676b0 0x7fd878069b70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd89c0ae400 0x7fd89c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd89c0adf80 0x7fd89c13dac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 --2- 172.21.15.119:0/1659462475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd880004d50 0x7fd89c13eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 >> 172.21.15.119:0/1659462475 conn(0x7fd89c0b66c0 msgr2=0x7fd89c0b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 shutdown_connections 2024-03-08T21:34:08.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.498+0000 7fd8a2600640 1 -- 172.21.15.119:0/1659462475 wait complete. 2024-03-08T21:34:08.503 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:08.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.650+0000 7f5115800640 1 Processor -- start 2024-03-08T21:34:08.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.650+0000 7f5115800640 1 -- start start 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f5115800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f511006c840 0x7f51100b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f5115800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5110140fb0 0x7f51101413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f5115800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511006cc20 con 0x7f5110144030 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f5115800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b3670 con 0x7f511006c840 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f5115800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b3950 con 0x7f5110140fb0 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510ea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f511006c840 0x7f51100b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510e000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5110144030 0x7f51101444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49364/0 (socket says 172.21.15.119:49364) 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510e000640 1 -- 172.21.15.119:0/379840120 learned_addr learned my addr 172.21.15.119:0/379840120 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510f400640 1 --2- 172.21.15.119:0/379840120 >> v2:172.21.15.160:3300/0 conn(0x7f5110140fb0 0x7f51101413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510ea00640 1 -- 172.21.15.119:0/379840120 >> v2:172.21.15.160:3300/0 conn(0x7f5110140fb0 msgr2=0x7f51101413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510ea00640 1 --2- 172.21.15.119:0/379840120 >> v2:172.21.15.160:3300/0 conn(0x7f5110140fb0 0x7f51101413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510ea00640 1 -- 172.21.15.119:0/379840120 >> v1:172.21.15.119:6789/0 conn(0x7f5110144030 legacy=0x7f51101444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510ea00640 1 -- 172.21.15.119:0/379840120 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100b3c30 con 0x7f511006c840 2024-03-08T21:34:08.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.654+0000 7f510d600640 1 -- 172.21.15.119:0/379840120 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542366415 0 0) 0x7f511006cc20 con 0x7f5110144030 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510ea00640 1 --2- 172.21.15.119:0/379840120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f511006c840 0x7f51100b3090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5110073540 tx=0x7f510001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b0a77dc2c8a7e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510d600640 1 -- 172.21.15.119:0/379840120 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000b0070 con 0x7f511006c840 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510d600640 1 -- 172.21.15.119:0/379840120 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51000ab600 con 0x7f511006c840 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510d600640 1 -- 172.21.15.119:0/379840120 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000ab9d0 con 0x7f511006c840 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- 172.21.15.119:0/379840120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f511006c840 msgr2=0x7f51100b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- 172.21.15.119:0/379840120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f511006c840 0x7f51100b3090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5110073540 tx=0x7f510001c3f0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- 172.21.15.119:0/379840120 shutdown_connections 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- 172.21.15.119:0/379840120 >> v2:172.21.15.160:3300/0 conn(0x7f5110140fb0 0x7f51101413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- 172.21.15.119:0/379840120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f511006c840 0x7f51100b3090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- 172.21.15.119:0/379840120 >> 172.21.15.119:0/379840120 conn(0x7f511009a230 msgr2=0x7f511009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- 172.21.15.119:0/379840120 shutdown_connections 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- 172.21.15.119:0/379840120 wait complete. 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 Processor -- start 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- start start 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f511006c840 0x7f5110146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5110140fb0 0x7f5110148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110150de0 con 0x7f5110144030 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511006e190 con 0x7f511006c840 2024-03-08T21:34:08.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f5115800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110150f60 con 0x7f5110140fb0 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56588/0 (socket says 172.21.15.119:56588) 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510f400640 1 -- 172.21.15.119:0/1453257110 learned_addr learned my addr 172.21.15.119:0/1453257110 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510ea00640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f511006c840 0x7f5110146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.658+0000 7f510e000640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5110140fb0 0x7f5110148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 -- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5110140fb0 msgr2=0x7f5110148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5110140fb0 0x7f5110148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 -- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f511006c840 msgr2=0x7f5110146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f511006c840 0x7f5110146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 -- 172.21.15.119:0/1453257110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51101461a0 con 0x7f5110144030 2024-03-08T21:34:08.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510f400640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5108007e70 tx=0x7f510800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108014620 con 0x7f5110144030 2024-03-08T21:34:08.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5108019070 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51101489b0 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5108014a20 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5110144e80 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110067db0 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5108014bc0 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 0x7f50f0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51080860d0 con 0x7f5110144030 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.662+0000 7f510ea00640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 0x7f50f0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.666+0000 7f510ea00640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 0x7f50f0069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f51000ad000 tx=0x7f5100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.666+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f5108056660 con 0x7f5110144030 2024-03-08T21:34:08.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.822+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5110141d00 con 0x7f5110144030 2024-03-08T21:34:08.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.822+0000 7f5106a00640 1 -- 172.21.15.119:0/1453257110 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f510805a700 con 0x7f5110144030 2024-03-08T21:34:08.809 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 msgr2=0x7f50f0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 0x7f50f0069b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f51000ad000 tx=0x7f5100008040 comp rx=0 tx=0).stop 2024-03-08T21:34:08.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 msgr2=0x7f511013f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5108007e70 tx=0x7f510800e4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 shutdown_connections 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f50f0067690 0x7f50f0069b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5110144030 0x7f511013f4e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5110140fb0 0x7f5110148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 --2- 172.21.15.119:0/1453257110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f511006c840 0x7f5110146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 >> 172.21.15.119:0/1453257110 conn(0x7f511009a230 msgr2=0x7f511009a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 shutdown_connections 2024-03-08T21:34:08.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.826+0000 7f5115800640 1 -- 172.21.15.119:0/1453257110 wait complete. 2024-03-08T21:34:08.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:08.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.978+0000 7f52b4400640 1 Processor -- start 2024-03-08T21:34:08.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 -- start start 2024-03-08T21:34:08.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52ac145b30 0x7f52ac142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ac06e0b0 con 0x7f52ac0b42b0 2024-03-08T21:34:08.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ac1456a0 con 0x7f52ac145b30 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b4400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac0b3850 con 0x7f52ac0b4690 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52ac145b30 0x7f52ac142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f52ac0b42b0 0x7f52ac06c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49370/0 (socket says 172.21.15.119:49370) 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1a00640 1 -- 172.21.15.119:0/428904184 learned_addr learned my addr 172.21.15.119:0/428904184 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b2400640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1000640 1 -- 172.21.15.119:0/428904184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 msgr2=0x7f52ac14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1000640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1000640 1 -- 172.21.15.119:0/428904184 >> v1:172.21.15.119:6789/0 conn(0x7f52ac0b42b0 legacy=0x7f52ac06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.982+0000 7f52b1000640 1 -- 172.21.15.119:0/428904184 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac145050 con 0x7f52ac145b30 2024-03-08T21:34:08.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b1000640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac145b30 0x7f52ac142380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52980097c0 tx=0x7f529801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351fc5361d1a5d66 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52abe00640 1 -- 172.21.15.119:0/428904184 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980b0070 con 0x7f52ac145b30 2024-03-08T21:34:08.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52abe00640 1 -- 172.21.15.119:0/428904184 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52980ab600 con 0x7f52ac145b30 2024-03-08T21:34:08.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52abe00640 1 -- 172.21.15.119:0/428904184 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52980ab9d0 con 0x7f52ac145b30 2024-03-08T21:34:08.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- 172.21.15.119:0/428904184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac145b30 msgr2=0x7f52ac142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac145b30 0x7f52ac142380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f52980097c0 tx=0x7f529801c410 comp rx=0 tx=0).stop 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- 172.21.15.119:0/428904184 shutdown_connections 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- 172.21.15.119:0/428904184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac145b30 0x7f52ac142380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- 172.21.15.119:0/428904184 >> 172.21.15.119:0/428904184 conn(0x7f52ac09a230 msgr2=0x7f52ac09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- 172.21.15.119:0/428904184 shutdown_connections 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- 172.21.15.119:0/428904184 wait complete. 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 Processor -- start 2024-03-08T21:34:08.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- start start 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 0x7f52ac14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1527d0 con 0x7f52ac0b42b0 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac152650 con 0x7f52ac145b30 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b4400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac152950 con 0x7f52ac0b4690 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.986+0000 7f52b1a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56610/0 (socket says 172.21.15.119:56610) 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 -- 172.21.15.119:0/781879916 learned_addr learned my addr 172.21.15.119:0/781879916 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b2400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 0x7f52ac14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 -- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 msgr2=0x7f52ac14e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1000640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 -- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 msgr2=0x7f52ac14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 0x7f52ac14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 -- 172.21.15.119:0/781879916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac0af920 con 0x7f52ac0b42b0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b2400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 0x7f52ac14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1a00640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c450 tx=0x7f52a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0017070 con 0x7f52ac0b42b0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a0005cf0 con 0x7f52ac0b42b0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0007290 con 0x7f52ac0b42b0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ac0b0820 con 0x7f52ac0b42b0 2024-03-08T21:34:08.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac0af380 con 0x7f52ac0b42b0 2024-03-08T21:34:08.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac067db0 con 0x7f52ac0b42b0 2024-03-08T21:34:08.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f52a001a070 con 0x7f52ac0b42b0 2024-03-08T21:34:08.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 0x7f528c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:08.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52a0084bc0 con 0x7f52ac0b42b0 2024-03-08T21:34:08.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.990+0000 7f52b1000640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 0x7f528c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:08.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.994+0000 7f52b1000640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 0x7f528c069b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52980ad000 tx=0x7f5298008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:08.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:08.994+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f52a0055830 con 0x7f52ac0b42b0 2024-03-08T21:34:09.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.150+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52ac09da10 con 0x7f52ac0b42b0 2024-03-08T21:34:09.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.150+0000 7f52a9600640 1 -- 172.21.15.119:0/781879916 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52a0055130 con 0x7f52ac0b42b0 2024-03-08T21:34:09.138 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 msgr2=0x7f528c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 0x7f528c069b50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f52980ad000 tx=0x7f5298008040 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 msgr2=0x7f52ac1e0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c450 tx=0x7f52a000c910 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 shutdown_connections 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f528c067690 0x7f528c069b50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52ac145b30 0x7f52ac14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52ac0b4690 0x7f52ac14e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 --2- 172.21.15.119:0/781879916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52ac0b42b0 0x7f52ac1e0020 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 >> 172.21.15.119:0/781879916 conn(0x7f52ac09a230 msgr2=0x7f52ac142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 shutdown_connections 2024-03-08T21:34:09.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.154+0000 7f52b4400640 1 -- 172.21.15.119:0/781879916 wait complete. 2024-03-08T21:34:09.158 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:09.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 Processor -- start 2024-03-08T21:34:09.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 -- start start 2024-03-08T21:34:09.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 0x7f70cc147a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70cc0b3c40 0x7f70cc09cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0b55f0 con 0x7f70cc0b5a10 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0b3250 con 0x7f70cc0b3c40 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70d3200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0b3480 con 0x7f70cc0b5210 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70cc0b3c40 0x7f70cc09cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70cc0b3c40 0x7f70cc09cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56618/0 (socket says 172.21.15.119:56618) 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 -- 172.21.15.119:0/3735148915 learned_addr learned my addr 172.21.15.119:0/3735148915 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 -- 172.21.15.119:0/3735148915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 msgr2=0x7f70cc147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cbe00640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 0x7f70cc147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 0x7f70cc147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 -- 172.21.15.119:0/3735148915 >> v1:172.21.15.160:6789/0 conn(0x7f70cc0b5a10 legacy=0x7f70cc14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cb400640 1 -- 172.21.15.119:0/3735148915 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc147250 con 0x7f70cc0b3c40 2024-03-08T21:34:09.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.306+0000 7f70cbe00640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 0x7f70cc147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:09.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70cb400640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc09cdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009870 tx=0x7f70bc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f41b56208e8c59 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70caa00640 1 -- 172.21.15.119:0/3735148915 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0b0070 con 0x7f70cc0b3c40 2024-03-08T21:34:09.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70caa00640 1 -- 172.21.15.119:0/3735148915 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0ab600 con 0x7f70cc0b3c40 2024-03-08T21:34:09.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70caa00640 1 -- 172.21.15.119:0/3735148915 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0ab9d0 con 0x7f70cc0b3c40 2024-03-08T21:34:09.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 -- 172.21.15.119:0/3735148915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 msgr2=0x7f70cc09cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc09cdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009870 tx=0x7f70bc01c400 comp rx=0 tx=0).stop 2024-03-08T21:34:09.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 -- 172.21.15.119:0/3735148915 shutdown_connections 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc09cdc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 --2- 172.21.15.119:0/3735148915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5210 0x7f70cc147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 -- 172.21.15.119:0/3735148915 >> 172.21.15.119:0/3735148915 conn(0x7f70cc06c620 msgr2=0x7f70cc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 -- 172.21.15.119:0/3735148915 shutdown_connections 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.310+0000 7f70d3200640 1 -- 172.21.15.119:0/3735148915 wait complete. 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 Processor -- start 2024-03-08T21:34:09.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- start start 2024-03-08T21:34:09.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 0x7f70cc0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 0x7f70cc0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc099bc0 con 0x7f70cc0b3c40 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc099a40 con 0x7f70cc0b5210 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc154a00 con 0x7f70cc0b5a10 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56624/0 (socket says 172.21.15.119:56624) 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 -- 172.21.15.119:0/162707376 learned_addr learned my addr 172.21.15.119:0/162707376 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d1200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 0x7f70cc0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cb400640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 0x7f70cc0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 -- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 msgr2=0x7f70cc0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 0x7f70cc0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 -- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 msgr2=0x7f70cc0adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 0x7f70cc0adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 -- 172.21.15.119:0/162707376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0b0230 con 0x7f70cc0b3c40 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cb400640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 0x7f70cc0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d1200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 0x7f70cc0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70cbe00640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c7f0 tx=0x7f70b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4007a30 con 0x7f70cc0b3c40 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4007bd0 con 0x7f70cc0b3c40 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40113f0 con 0x7f70cc0b3c40 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc072250 con 0x7f70cc0b3c40 2024-03-08T21:34:09.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc06fb40 con 0x7f70cc0b3c40 2024-03-08T21:34:09.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.314+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc067db0 con 0x7f70cc0b3c40 2024-03-08T21:34:09.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.318+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f70b4011590 con 0x7f70cc0b3c40 2024-03-08T21:34:09.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.318+0000 7f70c3e00640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 0x7f70a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.318+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70b4085a40 con 0x7f70cc0b3c40 2024-03-08T21:34:09.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.318+0000 7f70cb400640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 0x7f70a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.318+0000 7f70cb400640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 0x7f70a8069b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0ad000 tx=0x7f70bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.322+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f70b4015020 con 0x7f70cc0b3c40 2024-03-08T21:34:09.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.478+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70cc0b7a30 con 0x7f70cc0b3c40 2024-03-08T21:34:09.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70c3e00640 1 -- 172.21.15.119:0/162707376 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f70b4056750 con 0x7f70cc0b3c40 2024-03-08T21:34:09.467 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:09.467 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:09.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 msgr2=0x7f70a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 0x7f70a8069b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0ad000 tx=0x7f70bc008040 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 msgr2=0x7f70cc071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c7f0 tx=0x7f70b400ccb0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 shutdown_connections 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f70a8067660 0x7f70a8069b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70cc0b5a10 0x7f70cc0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70cc0b5210 0x7f70cc0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 --2- 172.21.15.119:0/162707376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70cc0b3c40 0x7f70cc071920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 >> 172.21.15.119:0/162707376 conn(0x7f70cc06c620 msgr2=0x7f70cc0b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 shutdown_connections 2024-03-08T21:34:09.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.482+0000 7f70d3200640 1 -- 172.21.15.119:0/162707376 wait complete. 2024-03-08T21:34:09.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:09.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:09.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 Processor -- start 2024-03-08T21:34:09.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 -- start start 2024-03-08T21:34:09.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbd0806afb0 0x7fbd080b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd080b8a00 0x7fbd0806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080aecb0 con 0x7fbd0806dae0 2024-03-08T21:34:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd080aef20 con 0x7fbd0806afb0 2024-03-08T21:34:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd0e200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080b8e60 con 0x7fbd080b8a00 2024-03-08T21:34:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbd0806dae0 0x7fbd0814a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49372/0 (socket says 172.21.15.119:49372) 2024-03-08T21:34:09.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07e00640 1 -- 172.21.15.119:0/2174463185 learned_addr learned my addr 172.21.15.119:0/2174463185 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07400640 1 --2- 172.21.15.119:0/2174463185 >> v2:172.21.15.160:3300/0 conn(0x7fbd0806afb0 0x7fbd080b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbcfea00640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd080b8a00 0x7fbd0806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd06a00640 1 -- 172.21.15.119:0/2174463185 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491257255 0 0) 0x7fbd080aecb0 con 0x7fbd0806dae0 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd06a00640 1 -- 172.21.15.119:0/2174463185 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcec003530 con 0x7fbd0806dae0 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07400640 1 -- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd080b8a00 msgr2=0x7fbd0806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07400640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd080b8a00 0x7fbd0806d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07400640 1 -- 172.21.15.119:0/2174463185 >> v1:172.21.15.119:6789/0 conn(0x7fbd0806dae0 legacy=0x7fbd0814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.638+0000 7fbd07400640 1 -- 172.21.15.119:0/2174463185 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0806b390 con 0x7fbd0806afb0 2024-03-08T21:34:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd07400640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd0806afb0 0x7fbd080b84c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80097c0 tx=0x7fbcf801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5aa39ce5eccccd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd06a00640 1 -- 172.21.15.119:0/2174463185 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80ab610 con 0x7fbd0806afb0 2024-03-08T21:34:09.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd06a00640 1 -- 172.21.15.119:0/2174463185 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf80b0070 con 0x7fbd0806afb0 2024-03-08T21:34:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd06a00640 1 -- 172.21.15.119:0/2174463185 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80ab9d0 con 0x7fbd0806afb0 2024-03-08T21:34:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 -- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd0806afb0 msgr2=0x7fbd080b84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd0806afb0 0x7fbd080b84c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80097c0 tx=0x7fbcf801c410 comp rx=0 tx=0).stop 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 -- 172.21.15.119:0/2174463185 shutdown_connections 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd080b8a00 0x7fbd0806d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 --2- 172.21.15.119:0/2174463185 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd0806afb0 0x7fbd080b84c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 -- 172.21.15.119:0/2174463185 >> 172.21.15.119:0/2174463185 conn(0x7fbd080b9540 msgr2=0x7fbd080b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 -- 172.21.15.119:0/2174463185 shutdown_connections 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.642+0000 7fbd0e200640 1 -- 172.21.15.119:0/2174463185 wait complete. 2024-03-08T21:34:09.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 Processor -- start 2024-03-08T21:34:09.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- start start 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd0806afb0 0x7fbd0814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd080b8a00 0x7fbd08145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080730f0 con 0x7fbd0806dae0 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080afdc0 con 0x7fbd080b8a00 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0806e300 con 0x7fbd0806afb0 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56632/0 (socket says 172.21.15.119:56632) 2024-03-08T21:34:09.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 -- 172.21.15.119:0/507551705 learned_addr learned my addr 172.21.15.119:0/507551705 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd07e00640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd080b8a00 0x7fbd08145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd07400640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd0806afb0 0x7fbd0814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 -- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd0806afb0 msgr2=0x7fbd0814a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd0806afb0 0x7fbd0814a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 -- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd080b8a00 msgr2=0x7fbd08145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd080b8a00 0x7fbd08145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 -- 172.21.15.119:0/507551705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0814d050 con 0x7fbd0806dae0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcfea00640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e870 tx=0x7fbcf000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0017070 con 0x7fbd0806dae0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000c940 con 0x7fbd0806dae0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0814d330 con 0x7fbd0806dae0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000ccf0 con 0x7fbd0806dae0 2024-03-08T21:34:09.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0814bda0 con 0x7fbd0806dae0 2024-03-08T21:34:09.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.646+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd08067db0 con 0x7fbd0806dae0 2024-03-08T21:34:09.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.650+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbcf001a070 con 0x7fbd0806dae0 2024-03-08T21:34:09.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.650+0000 7fbcffe00640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 0x7fbce4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.650+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcf0085720 con 0x7fbd0806dae0 2024-03-08T21:34:09.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.650+0000 7fbd07400640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 0x7fbce4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.650+0000 7fbd07400640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 0x7fbce4069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80af000 tx=0x7fbcf80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.654+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fbcf0056430 con 0x7fbd0806dae0 2024-03-08T21:34:09.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.806+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd080ae960 con 0x7fbd0806dae0 2024-03-08T21:34:09.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.806+0000 7fbcffe00640 1 -- 172.21.15.119:0/507551705 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcf0055d30 con 0x7fbd0806dae0 2024-03-08T21:34:09.794 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 msgr2=0x7fbce4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 0x7fbce4069b20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbcf80af000 tx=0x7fbcf80a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 msgr2=0x7fbd080b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000e870 tx=0x7fbcf000ec70 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 shutdown_connections 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbce4067660 0x7fbce4069b20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd080b8a00 0x7fbd08145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd0806dae0 0x7fbd080b2c70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 --2- 172.21.15.119:0/507551705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbd0806afb0 0x7fbd0814a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 >> 172.21.15.119:0/507551705 conn(0x7fbd080b9540 msgr2=0x7fbd080b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 shutdown_connections 2024-03-08T21:34:09.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.810+0000 7fbd0e200640 1 -- 172.21.15.119:0/507551705 wait complete. 2024-03-08T21:34:09.814 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.962+0000 7fabf6800640 1 Processor -- start 2024-03-08T21:34:09.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.962+0000 7fabf6800640 1 -- start start 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabf6800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf006c840 0x7fabf00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabf6800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fabf0144030 0x7fabf0144490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabf6800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf01449d0 con 0x7fabf0140fb0 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabf6800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf006cc20 con 0x7fabf0144030 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabf6800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00b3670 con 0x7fabf006c840 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fabf0144030 0x7fabf0144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabefe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fabf0140fb0 0x7fabf01413e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49382/0 (socket says 172.21.15.119:49382) 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabefe00640 1 -- 172.21.15.119:0/3173036361 learned_addr learned my addr 172.21.15.119:0/3173036361 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabef400640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf006c840 0x7fabf00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 -- 172.21.15.119:0/3173036361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf006c840 msgr2=0x7fabf00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf006c840 0x7fabf00b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 -- 172.21.15.119:0/3173036361 >> v1:172.21.15.119:6789/0 conn(0x7fabf0140fb0 legacy=0x7fabf01413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 -- 172.21.15.119:0/3173036361 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00b3950 con 0x7fabf0144030 2024-03-08T21:34:09.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabeea00640 1 -- 172.21.15.119:0/3173036361 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667760704 0 0) 0x7fabf01449d0 con 0x7fabf0140fb0 2024-03-08T21:34:09.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabe6a00640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf0144490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabf0144ba0 tx=0x7fabd801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915daf0275a53ee0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabeea00640 1 -- 172.21.15.119:0/3173036361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b0070 con 0x7fabf0144030 2024-03-08T21:34:09.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.966+0000 7fabeea00640 1 -- 172.21.15.119:0/3173036361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80ab600 con 0x7fabf0144030 2024-03-08T21:34:09.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabeea00640 1 -- 172.21.15.119:0/3173036361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80ab9d0 con 0x7fabf0144030 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- 172.21.15.119:0/3173036361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 msgr2=0x7fabf0144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf0144490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabf0144ba0 tx=0x7fabd801c410 comp rx=0 tx=0).stop 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- 172.21.15.119:0/3173036361 shutdown_connections 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf0144490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- 172.21.15.119:0/3173036361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf006c840 0x7fabf00b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- 172.21.15.119:0/3173036361 >> 172.21.15.119:0/3173036361 conn(0x7fabf009a230 msgr2=0x7fabf009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- 172.21.15.119:0/3173036361 shutdown_connections 2024-03-08T21:34:09.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- 172.21.15.119:0/3173036361 wait complete. 2024-03-08T21:34:09.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 Processor -- start 2024-03-08T21:34:09.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- start start 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabf006c840 0x7fabf0137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf0140fb0 0x7fabf01dd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf006d200 con 0x7fabf0144030 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf006d080 con 0x7fabf006c840 2024-03-08T21:34:09.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabf6800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf006d380 con 0x7fabf0140fb0 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56656/0 (socket says 172.21.15.119:56656) 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 -- 172.21.15.119:0/3962361135 learned_addr learned my addr 172.21.15.119:0/3962361135 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabef400640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabf006c840 0x7fabf0137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 -- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf0140fb0 msgr2=0x7fabf01dd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf0140fb0 0x7fabf01dd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 -- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabf006c840 msgr2=0x7fabf0137980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabf006c840 0x7fabf0137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.970+0000 7fabefe00640 1 -- 172.21.15.119:0/3962361135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0070160 con 0x7fabf0144030 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabefe00640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c470 tx=0x7fabe800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8018070 con 0x7fabf0144030 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe80074e0 con 0x7fabf0144030 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8004a30 con 0x7fabf0144030 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf01ddf50 con 0x7fabf0144030 2024-03-08T21:34:09.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf01dda70 con 0x7fabf0144030 2024-03-08T21:34:09.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf01ddd60 con 0x7fabf0144030 2024-03-08T21:34:09.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fabe8004bd0 con 0x7fabf0144030 2024-03-08T21:34:09.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:09.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabe8084ba0 con 0x7fabf0144030 2024-03-08T21:34:09.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabef400640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:09.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.974+0000 7fabef400640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 0x7fabcc069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009f30 tx=0x7fabe000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:09.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:09.978+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fabe80558b0 con 0x7fabf0144030 2024-03-08T21:34:10.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.134+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fabf0067db0 con 0x7fabf0144030 2024-03-08T21:34:10.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabe7e00640 1 -- 172.21.15.119:0/3962361135 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fabe80551b0 con 0x7fabf0144030 2024-03-08T21:34:10.124 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:10.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 msgr2=0x7fabcc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 0x7fabcc069b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009f30 tx=0x7fabe000b040 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 msgr2=0x7fabf009c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c470 tx=0x7fabe800c930 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 shutdown_connections 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fabcc067660 0x7fabcc069b20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fabf0144030 0x7fabf009c710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabf0140fb0 0x7fabf01dd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 --2- 172.21.15.119:0/3962361135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabf006c840 0x7fabf0137980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 >> 172.21.15.119:0/3962361135 conn(0x7fabf009a230 msgr2=0x7fabf00b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 shutdown_connections 2024-03-08T21:34:10.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.138+0000 7fabf6800640 1 -- 172.21.15.119:0/3962361135 wait complete. 2024-03-08T21:34:10.144 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 Processor -- start 2024-03-08T21:34:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 -- start start 2024-03-08T21:34:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4cd406c840 0x7f4cd40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 0x7f4cd41444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd4144a00 con 0x7f4cd4140fb0 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd406cc20 con 0x7f4cd406c840 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd9600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd40b3670 con 0x7f4cd4144030 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4cd406c840 0x7f4cd40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4cd406c840 0x7f4cd40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56660/0 (socket says 172.21.15.119:56660) 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 -- 172.21.15.119:0/2099931610 learned_addr learned my addr 172.21.15.119:0/2099931610 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2000640 1 --2- 172.21.15.119:0/2099931610 >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 0x7f4cd41444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 -- 172.21.15.119:0/2099931610 >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 msgr2=0x7f4cd41444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 --2- 172.21.15.119:0/2099931610 >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 0x7f4cd41444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 -- 172.21.15.119:0/2099931610 >> v1:172.21.15.119:6789/0 conn(0x7f4cd4140fb0 legacy=0x7f4cd41413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2a00640 1 -- 172.21.15.119:0/2099931610 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40b3950 con 0x7f4cd406c840 2024-03-08T21:34:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.294+0000 7f4cd2000640 1 --2- 172.21.15.119:0/2099931610 >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 0x7f4cd41444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:10.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd2a00640 1 --2- 172.21.15.119:0/2099931610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd406c840 0x7f4cd40b3090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406bac0 tx=0x7f4cc401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf09cae09be176c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd1600640 1 -- 172.21.15.119:0/2099931610 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40b0070 con 0x7f4cd406c840 2024-03-08T21:34:10.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd1600640 1 -- 172.21.15.119:0/2099931610 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc40ab600 con 0x7f4cd406c840 2024-03-08T21:34:10.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd1600640 1 -- 172.21.15.119:0/2099931610 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40ab9d0 con 0x7f4cd406c840 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- 172.21.15.119:0/2099931610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd406c840 msgr2=0x7f4cd40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 --2- 172.21.15.119:0/2099931610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd406c840 0x7f4cd40b3090 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4cd406bac0 tx=0x7f4cc401c490 comp rx=0 tx=0).stop 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- 172.21.15.119:0/2099931610 shutdown_connections 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 --2- 172.21.15.119:0/2099931610 >> v2:172.21.15.160:3300/0 conn(0x7f4cd4144030 0x7f4cd41444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 --2- 172.21.15.119:0/2099931610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd406c840 0x7f4cd40b3090 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- 172.21.15.119:0/2099931610 >> 172.21.15.119:0/2099931610 conn(0x7f4cd409a230 msgr2=0x7f4cd409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- 172.21.15.119:0/2099931610 shutdown_connections 2024-03-08T21:34:10.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- 172.21.15.119:0/2099931610 wait complete. 2024-03-08T21:34:10.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 Processor -- start 2024-03-08T21:34:10.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.298+0000 7f4cd9600640 1 -- start start 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cd406c840 0x7f4cd4140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cd4144030 0x7f4cd41dff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4150de0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd406e190 con 0x7f4cd4144030 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd4150f60 con 0x7f4cd406c840 2024-03-08T21:34:10.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56676/0 (socket says 172.21.15.119:56676) 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 -- 172.21.15.119:0/3325709723 learned_addr learned my addr 172.21.15.119:0/3325709723 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 -- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cd406c840 msgr2=0x7f4cd4140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cd406c840 0x7f4cd4140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 -- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cd4144030 msgr2=0x7f4cd41dff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cd4144030 0x7f4cd41dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 -- 172.21.15.119:0/3325709723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40b76b0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd2000640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e840 tx=0x7f4cc000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0017070 con 0x7f4cd4140fb0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000c8d0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd409cf30 con 0x7f4cd4140fb0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000f040 con 0x7f4cd4140fb0 2024-03-08T21:34:10.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd409bb20 con 0x7f4cd4140fb0 2024-03-08T21:34:10.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd4067db0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.302+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f4cc001a070 con 0x7f4cd4140fb0 2024-03-08T21:34:10.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.306+0000 7f4ccaa00640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 0x7f4cb4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.306+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cc0085450 con 0x7f4cd4140fb0 2024-03-08T21:34:10.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.306+0000 7f4cd2a00640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 0x7f4cb4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.306+0000 7f4cd2a00640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 0x7f4cb4069b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40ad000 tx=0x7f4cc4004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.310+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f4cc00560c0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cd409cc50 con 0x7f4cd4140fb0 2024-03-08T21:34:10.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4ccaa00640 1 -- 172.21.15.119:0/3325709723 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cc00559c0 con 0x7f4cd4140fb0 2024-03-08T21:34:10.452 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 msgr2=0x7f4cb4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 0x7f4cb4069b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40ad000 tx=0x7f4cc4004740 comp rx=0 tx=0).stop 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 msgr2=0x7f4cd41dfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e840 tx=0x7f4cc000ed00 comp rx=0 tx=0).stop 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 shutdown_connections 2024-03-08T21:34:10.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4cb4067690 0x7f4cb4069b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cd4144030 0x7f4cd41dff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cd4140fb0 0x7f4cd41dfa40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 --2- 172.21.15.119:0/3325709723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cd406c840 0x7f4cd4140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 >> 172.21.15.119:0/3325709723 conn(0x7f4cd409a230 msgr2=0x7f4cd4142360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 shutdown_connections 2024-03-08T21:34:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.466+0000 7f4cd9600640 1 -- 172.21.15.119:0/3325709723 wait complete. 2024-03-08T21:34:10.511 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-03-08T21:34:10.511 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-03-08T21:34:10.511 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 Processor -- start 2024-03-08T21:34:10.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 -- start start 2024-03-08T21:34:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b740b4370 0x7f9b740b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4750 0x7f9b740b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9b740b3810 0x7f9b7413eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740b6210 con 0x7f9b740b4370 2024-03-08T21:34:10.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b740b6e20 con 0x7f9b740b3810 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b740b5530 con 0x7f9b740b4750 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b72a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b740b4370 0x7f9b740b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b72a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9b740b4370 0x7f9b740b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56684/0 (socket says 172.21.15.119:56684) 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b72a00640 1 -- 172.21.15.119:0/2440007021 learned_addr learned my addr 172.21.15.119:0/2440007021 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b73400640 1 --2- 172.21.15.119:0/2440007021 >> v2:172.21.15.160:3300/0 conn(0x7f9b740b3810 0x7f9b7413eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.658+0000 7f9b72000640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4750 0x7f9b740b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 -- 172.21.15.119:0/2440007021 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4750 msgr2=0x7f9b740b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4750 0x7f9b740b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 -- 172.21.15.119:0/2440007021 >> v2:172.21.15.160:3300/0 conn(0x7f9b740b3810 msgr2=0x7f9b7413eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 --2- 172.21.15.119:0/2440007021 >> v2:172.21.15.160:3300/0 conn(0x7f9b740b3810 0x7f9b7413eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 -- 172.21.15.119:0/2440007021 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740b63e0 con 0x7f9b740b4370 2024-03-08T21:34:10.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b72a00640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b4370 0x7f9b740b1aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b740b6770 tx=0x7f9b6401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770861a83267368d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b71600640 1 -- 172.21.15.119:0/2440007021 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640b0070 con 0x7f9b740b4370 2024-03-08T21:34:10.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b71600640 1 -- 172.21.15.119:0/2440007021 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640a4e50 con 0x7f9b740b4370 2024-03-08T21:34:10.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b71600640 1 -- 172.21.15.119:0/2440007021 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab820 con 0x7f9b740b4370 2024-03-08T21:34:10.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b73e00640 1 -- 172.21.15.119:0/2440007021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b4370 msgr2=0x7f9b740b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.662+0000 7f9b73e00640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b4370 0x7f9b740b1aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b740b6770 tx=0x7f9b6401c400 comp rx=0 tx=0).stop 2024-03-08T21:34:10.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/2440007021 shutdown_connections 2024-03-08T21:34:10.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- 172.21.15.119:0/2440007021 >> v2:172.21.15.160:3300/0 conn(0x7f9b740b3810 0x7f9b7413eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4750 0x7f9b740b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- 172.21.15.119:0/2440007021 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b4370 0x7f9b740b1aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/2440007021 >> 172.21.15.119:0/2440007021 conn(0x7f9b740ba5a0 msgr2=0x7f9b740ba9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/2440007021 shutdown_connections 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/2440007021 wait complete. 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 Processor -- start 2024-03-08T21:34:10.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- start start 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 0x7f9b741455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b740b4750 0x7f9b7413b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74148d70 con 0x7f9b740b3810 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74148bf0 con 0x7f9b740b4750 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b74148ef0 con 0x7f9b740b4370 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56698/0 (socket says 172.21.15.119:56698) 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 -- 172.21.15.119:0/4234002286 learned_addr learned my addr 172.21.15.119:0/4234002286 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73400640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b740b4750 0x7f9b7413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72000640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 0x7f9b741455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 -- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 msgr2=0x7f9b741455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 0x7f9b741455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 -- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b740b4750 msgr2=0x7f9b7413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b740b4750 0x7f9b7413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 -- 172.21.15.119:0/4234002286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74136c20 con 0x7f9b740b3810 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72000640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 0x7f9b741455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b72a00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ae040 tx=0x7f9b640191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640b0040 con 0x7f9b740b3810 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640aa660 con 0x7f9b740b3810 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640aaa50 con 0x7f9b740b3810 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7413c9f0 con 0x7f9b740b3810 2024-03-08T21:34:10.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.666+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b74144fc0 con 0x7f9b740b3810 2024-03-08T21:34:10.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b74144af0 con 0x7f9b740b3810 2024-03-08T21:34:10.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9b640aabf0 con 0x7f9b740b3810 2024-03-08T21:34:10.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b6b400640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 0x7f9b54069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b6411f630 con 0x7f9b740b3810 2024-03-08T21:34:10.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b72000640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 0x7f9b54069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.670+0000 7f9b72000640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 0x7f9b54069b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b740baaf0 tx=0x7f9b60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.674+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f9b64016110 con 0x7f9b740b3810 2024-03-08T21:34:10.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b740750f0 con 0x7f9b740b3810 2024-03-08T21:34:10.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b6b400640 1 -- 172.21.15.119:0/4234002286 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f9b640f02a0 con 0x7f9b740b3810 2024-03-08T21:34:10.817 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:10.817 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 msgr2=0x7f9b54069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 0x7f9b54069b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b740baaf0 tx=0x7f9b60008040 comp rx=0 tx=0).stop 2024-03-08T21:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 msgr2=0x7f9b741445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ae040 tx=0x7f9b640191a0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 shutdown_connections 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9b54067690 0x7f9b54069b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b740b4750 0x7f9b7413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b740b4370 0x7f9b741455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.830+0000 7f9b73e00640 1 --2- 172.21.15.119:0/4234002286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9b740b3810 0x7f9b741445b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.834+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 >> 172.21.15.119:0/4234002286 conn(0x7f9b740ba5a0 msgr2=0x7f9b74135650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.834+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 shutdown_connections 2024-03-08T21:34:10.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.834+0000 7f9b73e00640 1 -- 172.21.15.119:0/4234002286 wait complete. 2024-03-08T21:34:10.838 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:10.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:10.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 Processor -- start 2024-03-08T21:34:10.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 -- start start 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6640b42b0 0x7fb66406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb664145b30 0x7fb664142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb6640b4690 0x7fb6641483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6641456a0 con 0x7fb6640b42b0 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6640b3850 con 0x7fb6640b4690 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb66b200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66406e0b0 con 0x7fb664145b30 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6640b42b0 0x7fb66406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6640b42b0 0x7fb66406c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56708/0 (socket says 172.21.15.119:56708) 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 -- 172.21.15.119:0/513335156 learned_addr learned my addr 172.21.15.119:0/513335156 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 -- 172.21.15.119:0/513335156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb664145b30 msgr2=0x7fb664142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 --2- 172.21.15.119:0/513335156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb664145b30 0x7fb664142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 -- 172.21.15.119:0/513335156 >> v2:172.21.15.160:3300/0 conn(0x7fb6640b4690 msgr2=0x7fb6641483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:10.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 --2- 172.21.15.119:0/513335156 >> v2:172.21.15.160:3300/0 conn(0x7fb6640b4690 0x7fb6641483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.990+0000 7fb663e00640 1 -- 172.21.15.119:0/513335156 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664145050 con 0x7fb6640b42b0 2024-03-08T21:34:10.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb663e00640 1 --2- 172.21.15.119:0/513335156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb66406c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb66406f5e0 tx=0x7fb65401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dce6185199c61b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb663400640 1 -- 172.21.15.119:0/513335156 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540b0070 con 0x7fb6640b42b0 2024-03-08T21:34:10.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb663400640 1 -- 172.21.15.119:0/513335156 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540ab600 con 0x7fb6640b42b0 2024-03-08T21:34:10.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb663400640 1 -- 172.21.15.119:0/513335156 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540ab9d0 con 0x7fb6640b42b0 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 -- 172.21.15.119:0/513335156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 msgr2=0x7fb66406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 --2- 172.21.15.119:0/513335156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb66406c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb66406f5e0 tx=0x7fb65401c490 comp rx=0 tx=0).stop 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 -- 172.21.15.119:0/513335156 shutdown_connections 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 --2- 172.21.15.119:0/513335156 >> v2:172.21.15.160:3300/0 conn(0x7fb6640b4690 0x7fb6641483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 --2- 172.21.15.119:0/513335156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb664145b30 0x7fb664142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 --2- 172.21.15.119:0/513335156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb66406c5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 -- 172.21.15.119:0/513335156 >> 172.21.15.119:0/513335156 conn(0x7fb66409a230 msgr2=0x7fb66409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 -- 172.21.15.119:0/513335156 shutdown_connections 2024-03-08T21:34:10.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 -- 172.21.15.119:0/513335156 wait complete. 2024-03-08T21:34:10.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.994+0000 7fb66b200640 1 Processor -- start 2024-03-08T21:34:10.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- start start 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6640b4690 0x7fb6640afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb664145b30 0x7fb66413ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb664151870 con 0x7fb6640b42b0 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6641516f0 con 0x7fb664145b30 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6641519f0 con 0x7fb6640b4690 2024-03-08T21:34:10.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56724/0 (socket says 172.21.15.119:56724) 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 -- 172.21.15.119:0/1404841701 learned_addr learned my addr 172.21.15.119:0/1404841701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb669200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb664145b30 0x7fb66413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb65b400640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6640b4690 0x7fb6640afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 -- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6640b4690 msgr2=0x7fb6640afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6640b4690 0x7fb6640afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 -- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb664145b30 msgr2=0x7fb66413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb664145b30 0x7fb66413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 -- 172.21.15.119:0/1404841701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640af8e0 con 0x7fb6640b42b0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb663e00640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb65401cd30 tx=0x7fb654019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540bb070 con 0x7fb6640b42b0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540b6640 con 0x7fb6640b42b0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540b0040 con 0x7fb6640b42b0 2024-03-08T21:34:10.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6641406a0 con 0x7fb6640b42b0 2024-03-08T21:34:10.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6640b0100 con 0x7fb6640b42b0 2024-03-08T21:34:10.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb664067db0 con 0x7fb6640b42b0 2024-03-08T21:34:10.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:10.998+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb6540b4430 con 0x7fb6640b42b0 2024-03-08T21:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.002+0000 7fb660c00640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 0x7fb640069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.002+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb65411f410 con 0x7fb6640b42b0 2024-03-08T21:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.002+0000 7fb65b400640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 0x7fb640069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:10.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.002+0000 7fb65b400640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 0x7fb640069b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:10.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.006+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb654016110 con 0x7fb6640b42b0 2024-03-08T21:34:11.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.158+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb664072fd0 con 0x7fb6640b42b0 2024-03-08T21:34:11.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.158+0000 7fb660c00640 1 -- 172.21.15.119:0/1404841701 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6540efa30 con 0x7fb6640b42b0 2024-03-08T21:34:11.147 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 msgr2=0x7fb640069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 0x7fb640069b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb64c006fd0 tx=0x7fb64c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 msgr2=0x7fb6640b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb65401cd30 tx=0x7fb654019230 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 shutdown_connections 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb640067660 0x7fb640069b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb664145b30 0x7fb66413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6640b4690 0x7fb6640afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 --2- 172.21.15.119:0/1404841701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6640b42b0 0x7fb6640b0440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 >> 172.21.15.119:0/1404841701 conn(0x7fb66409a230 msgr2=0x7fb664073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 shutdown_connections 2024-03-08T21:34:11.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.162+0000 7fb66b200640 1 -- 172.21.15.119:0/1404841701 wait complete. 2024-03-08T21:34:11.167 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:11.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 Processor -- start 2024-03-08T21:34:11.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 -- start start 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b36f0 0x7f05dc0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05dc1458b0 0x7f05dc13e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc144ca0 con 0x7f05dc0b2740 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc0b1aa0 con 0x7f05dc1458b0 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05e0c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0b2c90 con 0x7f05dc0b36f0 2024-03-08T21:34:11.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05da800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05dc1458b0 0x7f05dc13e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05d1400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f05dc0b2740 0x7f05dc1451a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49398/0 (socket says 172.21.15.119:49398) 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05d1400640 1 -- 172.21.15.119:0/1893180083 learned_addr learned my addr 172.21.15.119:0/1893180083 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05d9e00640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b36f0 0x7f05dc0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05da800640 1 -- 172.21.15.119:0/1893180083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b36f0 msgr2=0x7f05dc0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05da800640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b36f0 0x7f05dc0b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05da800640 1 -- 172.21.15.119:0/1893180083 >> v1:172.21.15.119:6789/0 conn(0x7f05dc0b2740 legacy=0x7f05dc1451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.307 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.318+0000 7f05da800640 1 -- 172.21.15.119:0/1893180083 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0b1cf0 con 0x7f05dc1458b0 2024-03-08T21:34:11.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05da800640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc1458b0 0x7f05dc13e8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009d90 tx=0x7f05d401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51eab24ec7524da server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05d9400640 1 -- 172.21.15.119:0/1893180083 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b2070 con 0x7f05dc1458b0 2024-03-08T21:34:11.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05d9400640 1 -- 172.21.15.119:0/1893180083 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40a5930 con 0x7f05dc1458b0 2024-03-08T21:34:11.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05d9400640 1 -- 172.21.15.119:0/1893180083 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d40a5d00 con 0x7f05dc1458b0 2024-03-08T21:34:11.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 -- 172.21.15.119:0/1893180083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc1458b0 msgr2=0x7f05dc13e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc1458b0 0x7f05dc13e8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009d90 tx=0x7f05d401c850 comp rx=0 tx=0).stop 2024-03-08T21:34:11.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 -- 172.21.15.119:0/1893180083 shutdown_connections 2024-03-08T21:34:11.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc1458b0 0x7f05dc13e8d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 --2- 172.21.15.119:0/1893180083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b36f0 0x7f05dc0b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 -- 172.21.15.119:0/1893180083 >> 172.21.15.119:0/1893180083 conn(0x7f05dc0ba680 msgr2=0x7f05dc0baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 -- 172.21.15.119:0/1893180083 shutdown_connections 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.322+0000 7f05e0c00640 1 -- 172.21.15.119:0/1893180083 wait complete. 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 Processor -- start 2024-03-08T21:34:11.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- start start 2024-03-08T21:34:11.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 0x7f05dc139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05dc1458b0 0x7f05dc13b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc1521d0 con 0x7f05dc0b36f0 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc152050 con 0x7f05dc1458b0 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc152350 con 0x7f05dc0b2740 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56744/0 (socket says 172.21.15.119:56744) 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 -- 172.21.15.119:0/642521724 learned_addr learned my addr 172.21.15.119:0/642521724 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05da800640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05dc1458b0 0x7f05dc13b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d9e00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 0x7f05dc139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 -- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 msgr2=0x7f05dc139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 0x7f05dc139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 -- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05dc1458b0 msgr2=0x7f05dc13b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05dc1458b0 0x7f05dc13b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 -- 172.21.15.119:0/642521724 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc13b600 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d9e00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 0x7f05dc139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d1400640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05c400c420 tx=0x7f05c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4017070 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4005cf0 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc138040 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40072f0 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc13bae0 con 0x7f05dc0b36f0 2024-03-08T21:34:11.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.326+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc067db0 con 0x7f05dc0b36f0 2024-03-08T21:34:11.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.330+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f05c401a070 con 0x7f05dc0b36f0 2024-03-08T21:34:11.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.330+0000 7f05d2a00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 0x7f05b8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.330+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05c4084c30 con 0x7f05dc0b36f0 2024-03-08T21:34:11.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.330+0000 7f05d9e00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 0x7f05b8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.330+0000 7f05d9e00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 0x7f05b8069b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009840 tx=0x7f05cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.334+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f05dc13b600 con 0x7f05dc0b36f0 2024-03-08T21:34:11.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05dc136500 con 0x7f05dc0b36f0 2024-03-08T21:34:11.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05d2a00640 1 -- 172.21.15.119:0/642521724 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05c4055940 con 0x7f05dc0b36f0 2024-03-08T21:34:11.480 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 msgr2=0x7f05b8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 0x7f05b8069b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009840 tx=0x7f05cc008040 comp rx=0 tx=0).stop 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 msgr2=0x7f05dc144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05c400c420 tx=0x7f05c400c8e0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 shutdown_connections 2024-03-08T21:34:11.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f05b8067690 0x7f05b8069b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05dc1458b0 0x7f05dc13b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05dc0b36f0 0x7f05dc144510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 --2- 172.21.15.119:0/642521724 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05dc0b2740 0x7f05dc139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 >> 172.21.15.119:0/642521724 conn(0x7f05dc0ba680 msgr2=0x7f05dc138b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 shutdown_connections 2024-03-08T21:34:11.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.494+0000 7f05e0c00640 1 -- 172.21.15.119:0/642521724 wait complete. 2024-03-08T21:34:11.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:11.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.650+0000 7f6a00400640 1 Processor -- start 2024-03-08T21:34:11.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.650+0000 7f6a00400640 1 -- start start 2024-03-08T21:34:11.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f6a00400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 0x7f69f80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f6a00400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69f8144030 0x7f69f81444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f6a00400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f8144a00 con 0x7f69f8140fb0 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f6a00400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f806cc20 con 0x7f69f8144030 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f6a00400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f80b3670 con 0x7f69f806c840 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fd000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f69f8144030 0x7f69f81444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fe400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f69f8140fb0 0x7f69f81413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49400/0 (socket says 172.21.15.119:49400) 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fe400640 1 -- 172.21.15.119:0/3203855926 learned_addr learned my addr 172.21.15.119:0/3203855926 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fda00640 1 --2- 172.21.15.119:0/3203855926 >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 0x7f69f80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fd000640 1 -- 172.21.15.119:0/3203855926 >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 msgr2=0x7f69f80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fd000640 1 --2- 172.21.15.119:0/3203855926 >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 0x7f69f80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fd000640 1 -- 172.21.15.119:0/3203855926 >> v1:172.21.15.119:6789/0 conn(0x7f69f8140fb0 legacy=0x7f69f81413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fd000640 1 -- 172.21.15.119:0/3203855926 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80b3950 con 0x7f69f8144030 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69f7e00640 1 -- 172.21.15.119:0/3203855926 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401950007 0 0) 0x7f69f8144a00 con 0x7f69f8140fb0 2024-03-08T21:34:11.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.654+0000 7f69fda00640 1 --2- 172.21.15.119:0/3203855926 >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 0x7f69f80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:11.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69fd000640 1 --2- 172.21.15.119:0/3203855926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f81444c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69f80b6040 tx=0x7f69e401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4305d4355d89c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69f7e00640 1 -- 172.21.15.119:0/3203855926 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40b0070 con 0x7f69f8144030 2024-03-08T21:34:11.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69f7e00640 1 -- 172.21.15.119:0/3203855926 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e40ab600 con 0x7f69f8144030 2024-03-08T21:34:11.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69f7e00640 1 -- 172.21.15.119:0/3203855926 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40ab9d0 con 0x7f69f8144030 2024-03-08T21:34:11.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- 172.21.15.119:0/3203855926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 msgr2=0x7f69f81444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- 172.21.15.119:0/3203855926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f81444c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f69f80b6040 tx=0x7f69e401c3f0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- 172.21.15.119:0/3203855926 shutdown_connections 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- 172.21.15.119:0/3203855926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f81444c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- 172.21.15.119:0/3203855926 >> v2:172.21.15.160:3300/0 conn(0x7f69f806c840 0x7f69f80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- 172.21.15.119:0/3203855926 >> 172.21.15.119:0/3203855926 conn(0x7f69f809a230 msgr2=0x7f69f809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- 172.21.15.119:0/3203855926 shutdown_connections 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- 172.21.15.119:0/3203855926 wait complete. 2024-03-08T21:34:11.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 Processor -- start 2024-03-08T21:34:11.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- start start 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 0x7f69f813b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69f8140fb0 0x7f69f813cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8150f60 con 0x7f69f8144030 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8150de0 con 0x7f69f8140fb0 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f6a00400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f81510e0 con 0x7f69f806c840 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69fe400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69fe400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56768/0 (socket says 172.21.15.119:56768) 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.658+0000 7f69fe400640 1 -- 172.21.15.119:0/1450932972 learned_addr learned my addr 172.21.15.119:0/1450932972 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:11.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fd000640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69f8140fb0 0x7f69f813cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fda00640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 0x7f69f813b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 -- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 msgr2=0x7f69f813b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 0x7f69f813b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 -- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69f8140fb0 msgr2=0x7f69f813cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69f8140fb0 0x7f69f813cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 -- 172.21.15.119:0/1450932972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f813df90 con 0x7f69f8144030 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fda00640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 0x7f69f813b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fe400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c7a0 tx=0x7f69f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0018070 con 0x7f69f8144030 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f000a640 con 0x7f69f8144030 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f813e270 con 0x7f69f8144030 2024-03-08T21:34:11.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000aa70 con 0x7f69f8144030 2024-03-08T21:34:11.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f81460e0 con 0x7f69f8144030 2024-03-08T21:34:11.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8147ab0 con 0x7f69f8144030 2024-03-08T21:34:11.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f69f001b070 con 0x7f69f8144030 2024-03-08T21:34:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 0x7f69d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69f0084d50 con 0x7f69f8144030 2024-03-08T21:34:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.662+0000 7f69fda00640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 0x7f69d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.666+0000 7f69fda00640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 0x7f69d8069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0079d0 tx=0x7f69ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.670+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f69f0088030 con 0x7f69f8144030 2024-03-08T21:34:11.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69f8067db0 con 0x7f69f8144030 2024-03-08T21:34:11.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f69f5600640 1 -- 172.21.15.119:0/1450932972 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69f0055410 con 0x7f69f8144030 2024-03-08T21:34:11.809 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 msgr2=0x7f69d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 0x7f69d8069b20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0079d0 tx=0x7f69ec008040 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 msgr2=0x7f69f813d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c7a0 tx=0x7f69f000cc60 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 shutdown_connections 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f69d8067660 0x7f69d8069b20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69f8144030 0x7f69f813d560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69f8140fb0 0x7f69f813cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 --2- 172.21.15.119:0/1450932972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69f806c840 0x7f69f813b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 >> 172.21.15.119:0/1450932972 conn(0x7f69f809a230 msgr2=0x7f69f806ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 shutdown_connections 2024-03-08T21:34:11.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.822+0000 7f6a00400640 1 -- 172.21.15.119:0/1450932972 wait complete. 2024-03-08T21:34:11.830 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-03-08T21:34:11.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 Processor -- start 2024-03-08T21:34:11.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 -- start start 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb30c066ad0 0x7fb30c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0afb10 0x7fb30c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c072980 con 0x7fb30c071c40 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c13e0d0 con 0x7fb30c066ad0 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb312000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c146f60 con 0x7fb30c0afb10 2024-03-08T21:34:11.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb30be00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb30c071c40 0x7fb30c13d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49416/0 (socket says 172.21.15.119:49416) 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb310c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb30c066ad0 0x7fb30c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb30be00640 1 -- 172.21.15.119:0/2469374749 learned_addr learned my addr 172.21.15.119:0/2469374749 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb311600640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0afb10 0x7fb30c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb310c00640 1 -- 172.21.15.119:0/2469374749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0afb10 msgr2=0x7fb30c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb310c00640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0afb10 0x7fb30c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb310c00640 1 -- 172.21.15.119:0/2469374749 >> v1:172.21.15.119:6789/0 conn(0x7fb30c071c40 legacy=0x7fb30c13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb310c00640 1 -- 172.21.15.119:0/2469374749 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c147240 con 0x7fb30c066ad0 2024-03-08T21:34:11.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.978+0000 7fb30b400640 1 -- 172.21.15.119:0/2469374749 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433113383 0 0) 0x7fb30c072980 con 0x7fb30c071c40 2024-03-08T21:34:11.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb310c00640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c066ad0 0x7fb30c147a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097c0 tx=0x7fb30001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacfb2222834a6d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb30b400640 1 -- 172.21.15.119:0/2469374749 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000b0070 con 0x7fb30c066ad0 2024-03-08T21:34:11.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb30b400640 1 -- 172.21.15.119:0/2469374749 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3000ab600 con 0x7fb30c066ad0 2024-03-08T21:34:11.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb30b400640 1 -- 172.21.15.119:0/2469374749 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000ab9d0 con 0x7fb30c066ad0 2024-03-08T21:34:11.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- 172.21.15.119:0/2469374749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c066ad0 msgr2=0x7fb30c147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c066ad0 0x7fb30c147a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097c0 tx=0x7fb30001c380 comp rx=0 tx=0).stop 2024-03-08T21:34:11.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- 172.21.15.119:0/2469374749 shutdown_connections 2024-03-08T21:34:11.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c0afb10 0x7fb30c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 --2- 172.21.15.119:0/2469374749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c066ad0 0x7fb30c147a40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- 172.21.15.119:0/2469374749 >> 172.21.15.119:0/2469374749 conn(0x7fb30c06ad50 msgr2=0x7fb30c06b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- 172.21.15.119:0/2469374749 shutdown_connections 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- 172.21.15.119:0/2469374749 wait complete. 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 Processor -- start 2024-03-08T21:34:11.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.982+0000 7fb312000640 1 -- start start 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 0x7fb30c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c071c40 0x7fb30c136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14edf0 con 0x7fb30c0afb10 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14ec70 con 0x7fb30c066ad0 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c14ef70 con 0x7fb30c071c40 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:56794/0 (socket says 172.21.15.119:56794) 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 -- 172.21.15.119:0/606387284 learned_addr learned my addr 172.21.15.119:0/606387284 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb310c00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 0x7fb30c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb30be00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c071c40 0x7fb30c136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 -- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c071c40 msgr2=0x7fb30c136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c071c40 0x7fb30c136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 -- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 msgr2=0x7fb30c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 0x7fb30c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 -- 172.21.15.119:0/606387284 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0b7bf0 con 0x7fb30c0afb10 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb310c00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 0x7fb30c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb311600640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb30400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304014420 con 0x7fb30c0afb10 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb304019070 con 0x7fb30c0afb10 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0b7910 con 0x7fb30c0afb10 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304014800 con 0x7fb30c0afb10 2024-03-08T21:34:11.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c144a90 con 0x7fb30c0afb10 2024-03-08T21:34:11.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c0750f0 con 0x7fb30c0afb10 2024-03-08T21:34:11.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.986+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb3040149a0 con 0x7fb30c0afb10 2024-03-08T21:34:11.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.990+0000 7fb308c00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 0x7fb2ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:11.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.990+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb304086040 con 0x7fb30c0afb10 2024-03-08T21:34:11.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.990+0000 7fb310c00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 0x7fb2ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:11.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.990+0000 7fb310c00640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 0x7fb2ec069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3000ad000 tx=0x7fb3000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:11.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:11.994+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb304056d50 con 0x7fb30c0afb10 2024-03-08T21:34:12.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.202+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) v1 -- 0x7fb30c0b9a00 con 0x7fb30c0afb10 2024-03-08T21:34:12.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.430+0000 7fb308c00640 1 -- 172.21.15.119:0/606387284 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v46) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb304056650 con 0x7fb30c0afb10 2024-03-08T21:34:12.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 msgr2=0x7fb2ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 0x7fb2ec069b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3000ad000 tx=0x7fb3000a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 msgr2=0x7fb30c1373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb304009fd0 tx=0x7fb30400e4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 shutdown_connections 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb2ec067660 0x7fb2ec069b20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0afb10 0x7fb30c1373e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c071c40 0x7fb30c136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 --2- 172.21.15.119:0/606387284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c066ad0 0x7fb30c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 >> 172.21.15.119:0/606387284 conn(0x7fb30c06ad50 msgr2=0x7fb30c0b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 shutdown_connections 2024-03-08T21:34:12.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.434+0000 7fb312000640 1 -- 172.21.15.119:0/606387284 wait complete. 2024-03-08T21:34:12.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-08T21:34:12.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 Processor -- start 2024-03-08T21:34:12.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 -- start start 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac5c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c06e0b0 con 0x7fac5c0b42b0 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c145050 con 0x7fac5c145b30 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac61c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c142a90 con 0x7fac5c0b4690 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5aa00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fac5c0b42b0 0x7fac5c06c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33062/0 (socket says 172.21.15.119:33062) 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5aa00640 1 -- 172.21.15.119:0/709229286 learned_addr learned my addr 172.21.15.119:0/709229286 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:12.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5b400640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac5c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576519556 0 0) 0x7fac5c06e0b0 con 0x7fac5c0b42b0 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac40003530 con 0x7fac5c0b42b0 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226192515 0 0) 0x7fac5c145050 con 0x7fac5c145b30 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac5c06e0b0 con 0x7fac5c145b30 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279608026 0 0) 0x7fac40003530 con 0x7fac5c0b42b0 2024-03-08T21:34:12.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 msgr2=0x7fac5c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac5c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 >> v1:172.21.15.160:6789/0 conn(0x7fac5c145b30 legacy=0x7fac5c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c145330 con 0x7fac5c0b42b0 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fac4c001680 con 0x7fac5c0b42b0 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 >> v1:172.21.15.119:6789/0 conn(0x7fac5c0b42b0 legacy=0x7fac5c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac40003b80 0x7fac40003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40004d50 0x7fac400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c142a90 con 0x7fac40004d50 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4000bad0 con 0x7fac40003b80 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.590+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4000bcd0 con 0x7fac5c0b4690 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40004d50 0x7fac400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5aa00640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac40003b80 0x7fac40003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac52000640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 -- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 msgr2=0x7fac40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac5c0b4690 0x7fac40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 -- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac40003b80 msgr2=0x7fac40003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac40003b80 0x7fac40003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 -- 172.21.15.119:0/709229286 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40003530 con 0x7fac40004d50 2024-03-08T21:34:12.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5b400640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40004d50 0x7fac400051d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac54009fc0 tx=0x7fac5401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bd364e297f0326 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:12.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540b2070 con 0x7fac40004d50 2024-03-08T21:34:12.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540a5c90 con 0x7fac40004d50 2024-03-08T21:34:12.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac5a000640 1 -- 172.21.15.119:0/709229286 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54009c10 con 0x7fac40004d50 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac61c00640 1 -- 172.21.15.119:0/709229286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40004d50 msgr2=0x7fac400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.594+0000 7fac61c00640 1 --2- 172.21.15.119:0/709229286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac40004d50 0x7fac400051d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac54009fc0 tx=0x7fac5401cc80 comp rx=0 tx=0).stop 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac5b400640 1 -- 172.21.15.119:0/709229286 reap_dead start 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/709229286 shutdown_connections 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/709229286 >> 172.21.15.119:0/709229286 conn(0x7fac5c09a230 msgr2=0x7fac5c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/709229286 shutdown_connections 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/709229286 wait complete. 2024-03-08T21:34:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 Processor -- start 2024-03-08T21:34:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- start start 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac40004d50 0x7fac5c1417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac5c1dfd70 0x7fac5c13ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c1456a0 con 0x7fac5c0724d0 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b4d70 con 0x7fac5c1dfd70 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b3850 con 0x7fac40004d50 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49768/0 (socket says 172.21.15.119:49768) 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 -- 172.21.15.119:0/3917232517 learned_addr learned my addr 172.21.15.119:0/3917232517 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac5aa00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac40004d50 0x7fac5c1417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac5b400640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac5c1dfd70 0x7fac5c13ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 -- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac40004d50 msgr2=0x7fac5c1417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac40004d50 0x7fac5c1417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 -- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac5c1dfd70 msgr2=0x7fac5c13ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac5c1dfd70 0x7fac5c13ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 -- 172.21.15.119:0/3917232517 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c071dd0 con 0x7fac5c0724d0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac52000640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac44012830 tx=0x7fac44012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44010b70 con 0x7fac5c0724d0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4401b070 con 0x7fac5c0724d0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44016480 con 0x7fac5c0724d0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c0705b0 con 0x7fac5c0724d0 2024-03-08T21:34:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.598+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c09c670 con 0x7fac5c0724d0 2024-03-08T21:34:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c09d6b0 con 0x7fac5c0724d0 2024-03-08T21:34:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fac44016620 con 0x7fac5c0724d0 2024-03-08T21:34:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac53400640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 0x7fac38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac44089080 con 0x7fac5c0724d0 2024-03-08T21:34:12.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac5aa00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 0x7fac38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:12.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.602+0000 7fac5aa00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 0x7fac38069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fac4c000c10 tx=0x7fac4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:12.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.606+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fac5c09d6b0 con 0x7fac5c0724d0 2024-03-08T21:34:12.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.758+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fac5c067db0 con 0x7fac5c0724d0 2024-03-08T21:34:12.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.762+0000 7fac53400640 1 -- 172.21.15.119:0/3917232517 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac44059cf0 con 0x7fac5c0724d0 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 msgr2=0x7fac38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 0x7fac38069b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fac4c000c10 tx=0x7fac4c009040 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 msgr2=0x7fac5c070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac44012830 tx=0x7fac44012cf0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 shutdown_connections 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fac38067660 0x7fac38069b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac5c1dfd70 0x7fac5c13ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac5c0724d0 0x7fac5c070a10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 --2- 172.21.15.119:0/3917232517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac40004d50 0x7fac5c1417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 >> 172.21.15.119:0/3917232517 conn(0x7fac5c09a230 msgr2=0x7fac5c142150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:12.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 shutdown_connections 2024-03-08T21:34:12.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:12.766+0000 7fac61c00640 1 -- 172.21.15.119:0/3917232517 wait complete. 2024-03-08T21:34:12.772 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-08T21:34:12.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T21:34:12.818 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T21:34:12.923 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-08T21:34:12.923 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:12.924 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T21:34:12.932 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:12.932 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T21:34:12.983 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:13.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 Processor -- start 2024-03-08T21:34:13.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 -- start start 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2eec0bb020 0x7f2eec06e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2eec06faa0 0x7f2eec144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eec0b8d80 con 0x7f2eec144850 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0b9480 con 0x7f2eec06faa0 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef3e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0bb400 con 0x7f2eec0bb020 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2eec06faa0 0x7f2eec144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2eec06faa0 0x7f2eec144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49784/0 (socket says 172.21.15.119:49784) 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 -- 172.21.15.119:0/1089490384 learned_addr learned my addr 172.21.15.119:0/1089490384 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef1e00640 1 --1- 172.21.15.119:0/1089490384 >> v1:172.21.15.119:6789/0 conn(0x7f2eec144850 0x7f2eec14a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33072/0 (socket says 172.21.15.119:33072) 2024-03-08T21:34:13.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef1400640 1 --2- 172.21.15.119:0/1089490384 >> v2:172.21.15.160:3300/0 conn(0x7f2eec0bb020 0x7f2eec06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 -- 172.21.15.119:0/1089490384 >> v2:172.21.15.160:3300/0 conn(0x7f2eec0bb020 msgr2=0x7f2eec06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 --2- 172.21.15.119:0/1089490384 >> v2:172.21.15.160:3300/0 conn(0x7f2eec0bb020 0x7f2eec06e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 -- 172.21.15.119:0/1089490384 >> v1:172.21.15.119:6789/0 conn(0x7f2eec144850 legacy=0x7f2eec14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2ef0a00640 1 -- 172.21.15.119:0/1089490384 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec072b60 con 0x7f2eec06faa0 2024-03-08T21:34:13.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.174+0000 7f2eebe00640 1 -- 172.21.15.119:0/1089490384 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377984632 0 0) 0x7f2eec0b8d80 con 0x7f2eec144850 2024-03-08T21:34:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef0a00640 1 --2- 172.21.15.119:0/1089490384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec06faa0 0x7f2eec144310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2eec09a040 tx=0x7f2ed801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55516f43d57b53c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2eebe00640 1 -- 172.21.15.119:0/1089490384 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80b2070 con 0x7f2eec06faa0 2024-03-08T21:34:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2eebe00640 1 -- 172.21.15.119:0/1089490384 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80ad680 con 0x7f2eec06faa0 2024-03-08T21:34:13.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2eebe00640 1 -- 172.21.15.119:0/1089490384 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80ada50 con 0x7f2eec06faa0 2024-03-08T21:34:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 -- 172.21.15.119:0/1089490384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec06faa0 msgr2=0x7f2eec144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/1089490384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec06faa0 0x7f2eec144310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2eec09a040 tx=0x7f2ed801c490 comp rx=0 tx=0).stop 2024-03-08T21:34:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 -- 172.21.15.119:0/1089490384 shutdown_connections 2024-03-08T21:34:13.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/1089490384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec06faa0 0x7f2eec144310 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/1089490384 >> v2:172.21.15.160:3300/0 conn(0x7f2eec0bb020 0x7f2eec06e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 -- 172.21.15.119:0/1089490384 >> 172.21.15.119:0/1089490384 conn(0x7f2eec099a40 msgr2=0x7f2eec0ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 -- 172.21.15.119:0/1089490384 shutdown_connections 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.178+0000 7f2ef3e00640 1 -- 172.21.15.119:0/1089490384 wait complete. 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 Processor -- start 2024-03-08T21:34:13.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- start start 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eec06faa0 0x7f2eec1dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eec0bb020 0x7f2eec13dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec09fc10 con 0x7f2eec144850 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec09fa90 con 0x7f2eec0bb020 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec1548b0 con 0x7f2eec06faa0 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49786/0 (socket says 172.21.15.119:49786) 2024-03-08T21:34:13.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 -- 172.21.15.119:0/3882309607 learned_addr learned my addr 172.21.15.119:0/3882309607 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef0a00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eec0bb020 0x7f2eec13dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1400640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eec06faa0 0x7f2eec1dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 -- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eec06faa0 msgr2=0x7f2eec1dfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eec06faa0 0x7f2eec1dfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 -- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eec0bb020 msgr2=0x7f2eec13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eec0bb020 0x7f2eec13dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 -- 172.21.15.119:0/3882309607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec13b7a0 con 0x7f2eec144850 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef1e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400c700 tx=0x7f2ee400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4018070 con 0x7f2eec144850 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400ce10 con 0x7f2eec144850 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400a880 con 0x7f2eec144850 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec13f5d0 con 0x7f2eec144850 2024-03-08T21:34:13.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec06be60 con 0x7f2eec144850 2024-03-08T21:34:13.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.182+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec067db0 con 0x7f2eec144850 2024-03-08T21:34:13.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.186+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ee401b070 con 0x7f2eec144850 2024-03-08T21:34:13.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.186+0000 7f2ee9600640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 0x7f2ecc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.186+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ee4084ef0 con 0x7f2eec144850 2024-03-08T21:34:13.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.186+0000 7f2ef1400640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 0x7f2ecc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.186+0000 7f2ef1400640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 0x7f2ecc069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b9d0 tx=0x7f2ee0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.190+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2ee4055ad0 con 0x7f2eec144850 2024-03-08T21:34:13.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.349+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eec06ea40 con 0x7f2eec144850 2024-03-08T21:34:13.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.349+0000 7f2ee9600640 1 -- 172.21.15.119:0/3882309607 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f2ee40553d0 con 0x7f2eec144850 2024-03-08T21:34:13.338 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:13.338 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 msgr2=0x7f2ecc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 0x7f2ecc069b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b9d0 tx=0x7f2ee0008040 comp rx=0 tx=0).stop 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 msgr2=0x7f2eec140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400c700 tx=0x7f2ee400cbc0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 shutdown_connections 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ecc067660 0x7f2ecc069b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2eec144850 0x7f2eec140420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2eec0bb020 0x7f2eec13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 --2- 172.21.15.119:0/3882309607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2eec06faa0 0x7f2eec1dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 >> 172.21.15.119:0/3882309607 conn(0x7f2eec099a40 msgr2=0x7f2eec1477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:13.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 shutdown_connections 2024-03-08T21:34:13.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.353+0000 7f2ef3e00640 1 -- 172.21.15.119:0/3882309607 wait complete. 2024-03-08T21:34:13.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:13.360 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:13.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 Processor -- start 2024-03-08T21:34:13.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 -- start start 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa6f406c840 0x7fa6f40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f4140fb0 0x7fa6f41413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f406cc20 con 0x7fa6f4144030 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40b3670 con 0x7fa6f406c840 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40b3950 con 0x7fa6f4140fb0 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6ebe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa6f4144030 0x7fa6f41444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33082/0 (socket says 172.21.15.119:33082) 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6ebe00640 1 -- 172.21.15.119:0/3814016414 learned_addr learned my addr 172.21.15.119:0/3814016414 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:13.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/3814016414 >> v2:172.21.15.160:3300/0 conn(0x7fa6f406c840 0x7fa6f40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f3400640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f4140fb0 0x7fa6f41413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2000640 1 -- 172.21.15.119:0/3814016414 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958144693 0 0) 0x7fa6f406cc20 con 0x7fa6f4144030 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2000640 1 -- 172.21.15.119:0/3814016414 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8003530 con 0x7fa6f4144030 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2a00640 1 -- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f4140fb0 msgr2=0x7fa6f41413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f4140fb0 0x7fa6f41413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2a00640 1 -- 172.21.15.119:0/3814016414 >> v1:172.21.15.119:6789/0 conn(0x7fa6f4144030 legacy=0x7fa6f41444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.513+0000 7fa6f2a00640 1 -- 172.21.15.119:0/3814016414 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4141920 con 0x7fa6f406c840 2024-03-08T21:34:13.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f406c840 0x7fa6f40b3090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097c0 tx=0x7fa6e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d46d6b2fe57df643 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f2000640 1 -- 172.21.15.119:0/3814016414 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40b0070 con 0x7fa6f406c840 2024-03-08T21:34:13.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f2000640 1 -- 172.21.15.119:0/3814016414 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e40ab600 con 0x7fa6f406c840 2024-03-08T21:34:13.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f2000640 1 -- 172.21.15.119:0/3814016414 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40ab9d0 con 0x7fa6f406c840 2024-03-08T21:34:13.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 -- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f406c840 msgr2=0x7fa6f40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f406c840 0x7fa6f40b3090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097c0 tx=0x7fa6e401c410 comp rx=0 tx=0).stop 2024-03-08T21:34:13.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 -- 172.21.15.119:0/3814016414 shutdown_connections 2024-03-08T21:34:13.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f4140fb0 0x7fa6f41413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/3814016414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f406c840 0x7fa6f40b3090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 -- 172.21.15.119:0/3814016414 >> 172.21.15.119:0/3814016414 conn(0x7fa6f409a230 msgr2=0x7fa6f409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:13.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 -- 172.21.15.119:0/3814016414 shutdown_connections 2024-03-08T21:34:13.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 -- 172.21.15.119:0/3814016414 wait complete. 2024-03-08T21:34:13.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.517+0000 7fa6f9c00640 1 Processor -- start 2024-03-08T21:34:13.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- start start 2024-03-08T21:34:13.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f406c840 0x7fa6f4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f4144030 0x7fa6f40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4150de0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f406e190 con 0x7fa6f4144030 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4150f60 con 0x7fa6f406c840 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49790/0 (socket says 172.21.15.119:49790) 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 -- 172.21.15.119:0/2294324253 learned_addr learned my addr 172.21.15.119:0/2294324253 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f406c840 0x7fa6f4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f3400640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f4144030 0x7fa6f40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 -- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f406c840 msgr2=0x7fa6f4070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f406c840 0x7fa6f4070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 -- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f4144030 msgr2=0x7fa6f40703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f4144030 0x7fa6f40703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 -- 172.21.15.119:0/2294324253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f41491c0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6ebe00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c3f0 tx=0x7fa6dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc017070 con 0x7fa6f4140fb0 2024-03-08T21:34:13.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc005cf0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f406f8c0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc0072f0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f41479d0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.521+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4067db0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.525+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa6dc01a070 con 0x7fa6f4140fb0 2024-03-08T21:34:13.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.525+0000 7fa6eaa00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 0x7fa6d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.525+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6dc084d30 con 0x7fa6f4140fb0 2024-03-08T21:34:13.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.525+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 0x7fa6d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.525+0000 7fa6f2a00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 0x7fa6d0069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40ad000 tx=0x7fa6e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.529+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa6dc0552c0 con 0x7fa6f4140fb0 2024-03-08T21:34:13.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6f40b8260 con 0x7fa6f4140fb0 2024-03-08T21:34:13.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6eaa00640 1 -- 172.21.15.119:0/2294324253 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6dc059360 con 0x7fa6f4140fb0 2024-03-08T21:34:13.672 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:13.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 msgr2=0x7fa6d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 0x7fa6d0069b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40ad000 tx=0x7fa6e4008040 comp rx=0 tx=0).stop 2024-03-08T21:34:13.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 msgr2=0x7fa6f4147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c3f0 tx=0x7fa6dc00c8b0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 shutdown_connections 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa6d0067660 0x7fa6d0069b20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6f4144030 0x7fa6f40703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f4140fb0 0x7fa6f4147300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 --2- 172.21.15.119:0/2294324253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6f406c840 0x7fa6f4070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 >> 172.21.15.119:0/2294324253 conn(0x7fa6f409a230 msgr2=0x7fa6f41429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 shutdown_connections 2024-03-08T21:34:13.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.685+0000 7fa6f9c00640 1 -- 172.21.15.119:0/2294324253 wait complete. 2024-03-08T21:34:13.693 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:13.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 Processor -- start 2024-03-08T21:34:13.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 -- start start 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f780c0b42b0 0x7f780c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b4690 0x7f780c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c06e0b0 con 0x7f780c145b30 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c142a90 con 0x7f780c0b42b0 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7813000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1456a0 con 0x7f780c0b4690 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f780c0b42b0 0x7f780c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f780c0b42b0 0x7f780c06c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49800/0 (socket says 172.21.15.119:49800) 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 -- 172.21.15.119:0/2211904607 learned_addr learned my addr 172.21.15.119:0/2211904607 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:13.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f7811000640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b4690 0x7f780c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 -- 172.21.15.119:0/2211904607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b4690 msgr2=0x7f780c14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:13.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b4690 0x7f780c14f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 -- 172.21.15.119:0/2211904607 >> v1:172.21.15.160:6789/0 conn(0x7f780c145b30 legacy=0x7f780c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.841+0000 7f780be00640 1 -- 172.21.15.119:0/2211904607 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c145050 con 0x7f780c0b42b0 2024-03-08T21:34:13.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f780be00640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b42b0 0x7f780c06c5e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e50 tx=0x7f77fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1276bd26191d7393 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f780b400640 1 -- 172.21.15.119:0/2211904607 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0a5660 con 0x7f780c0b42b0 2024-03-08T21:34:13.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f780b400640 1 -- 172.21.15.119:0/2211904607 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0a5800 con 0x7f780c0b42b0 2024-03-08T21:34:13.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f780b400640 1 -- 172.21.15.119:0/2211904607 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0a5bd0 con 0x7f780c0b42b0 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 -- 172.21.15.119:0/2211904607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b42b0 msgr2=0x7f780c06c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b42b0 0x7f780c06c5e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e50 tx=0x7f77fc01c9a0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 -- 172.21.15.119:0/2211904607 shutdown_connections 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b4690 0x7f780c14f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 --2- 172.21.15.119:0/2211904607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b42b0 0x7f780c06c5e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 -- 172.21.15.119:0/2211904607 >> 172.21.15.119:0/2211904607 conn(0x7f780c09a230 msgr2=0x7f780c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 -- 172.21.15.119:0/2211904607 shutdown_connections 2024-03-08T21:34:13.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.845+0000 7f7813000640 1 -- 172.21.15.119:0/2211904607 wait complete. 2024-03-08T21:34:13.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 Processor -- start 2024-03-08T21:34:13.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- start start 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b42b0 0x7f780c13f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f780c145b30 0x7f780c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c1527d0 con 0x7f780c0b4690 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c152650 con 0x7f780c145b30 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c152950 con 0x7f780c0b42b0 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49812/0 (socket says 172.21.15.119:49812) 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 -- 172.21.15.119:0/2775275047 learned_addr learned my addr 172.21.15.119:0/2775275047 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7811000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f780c145b30 0x7f780c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f780be00640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b42b0 0x7f780c13f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 -- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b42b0 msgr2=0x7f780c13f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b42b0 0x7f780c13f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 -- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f780c145b30 msgr2=0x7f780c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:13.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f780c145b30 0x7f780c0afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:13.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 -- 172.21.15.119:0/2775275047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0b08d0 con 0x7f780c0b4690 2024-03-08T21:34:13.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7803400640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c430 tx=0x7f77f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40052d0 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4005470 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4007260 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c0af880 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.849+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0b1040 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c067db0 con 0x7f780c0b4690 2024-03-08T21:34:13.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f77f4007400 con 0x7f780c0b4690 2024-03-08T21:34:13.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f7808c00640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 0x7f77e8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:13.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f4084b90 con 0x7f780c0b4690 2024-03-08T21:34:13.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f780be00640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 0x7f77e8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:13.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.853+0000 7f780be00640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 0x7f77e8069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ae000 tx=0x7f77fc0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:13.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:13.857+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f77f4055250 con 0x7f780c0b4690 2024-03-08T21:34:14.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.013+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f780c09da10 con 0x7f780c0b4690 2024-03-08T21:34:14.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.013+0000 7f7808c00640 1 -- 172.21.15.119:0/2775275047 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77f40592f0 con 0x7f780c0b4690 2024-03-08T21:34:14.002 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:14.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 msgr2=0x7f77e8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 0x7f77e8069b20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ae000 tx=0x7f77fc0a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 msgr2=0x7f780c0addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c430 tx=0x7f77f400c830 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 shutdown_connections 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f77e8067660 0x7f77e8069b20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f780c145b30 0x7f780c0afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f780c0b4690 0x7f780c0addc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 --2- 172.21.15.119:0/2775275047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f780c0b42b0 0x7f780c13f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 >> 172.21.15.119:0/2775275047 conn(0x7f780c09a230 msgr2=0x7f780c142150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 shutdown_connections 2024-03-08T21:34:14.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.017+0000 7f7813000640 1 -- 172.21.15.119:0/2775275047 wait complete. 2024-03-08T21:34:14.023 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:14.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 Processor -- start 2024-03-08T21:34:14.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 -- start start 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f649c06c840 0x7f649c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c06cc20 con 0x7f649c140fb0 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649c0b3670 con 0x7f649c144030 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f64a1a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0b3950 con 0x7f649c06c840 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f649c06c840 0x7f649c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f649c06c840 0x7f649c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49824/0 (socket says 172.21.15.119:49824) 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 -- 172.21.15.119:0/832691750 learned_addr learned my addr 172.21.15.119:0/832691750 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649b400640 1 --1- 172.21.15.119:0/832691750 >> v1:172.21.15.119:6789/0 conn(0x7f649c140fb0 0x7f649c1413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33090/0 (socket says 172.21.15.119:33090) 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 -- 172.21.15.119:0/832691750 >> v1:172.21.15.160:6789/0 conn(0x7f649c144030 legacy=0x7f649c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:14.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 -- 172.21.15.119:0/832691750 >> v1:172.21.15.119:6789/0 conn(0x7f649c140fb0 legacy=0x7f649c1413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.173+0000 7f649aa00640 1 -- 172.21.15.119:0/832691750 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0b3c30 con 0x7f649c06c840 2024-03-08T21:34:14.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f649aa00640 1 --2- 172.21.15.119:0/832691750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c06c840 0x7f649c0b3090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f648c009870 tx=0x7f648c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4432455bf0076d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f649a000640 1 -- 172.21.15.119:0/832691750 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b0070 con 0x7f649c06c840 2024-03-08T21:34:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f649a000640 1 -- 172.21.15.119:0/832691750 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c0ab600 con 0x7f649c06c840 2024-03-08T21:34:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f649a000640 1 -- 172.21.15.119:0/832691750 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0ab9d0 con 0x7f649c06c840 2024-03-08T21:34:14.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 -- 172.21.15.119:0/832691750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c06c840 msgr2=0x7f649c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 --2- 172.21.15.119:0/832691750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c06c840 0x7f649c0b3090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f648c009870 tx=0x7f648c01c490 comp rx=0 tx=0).stop 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 -- 172.21.15.119:0/832691750 shutdown_connections 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 --2- 172.21.15.119:0/832691750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c06c840 0x7f649c0b3090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 -- 172.21.15.119:0/832691750 >> 172.21.15.119:0/832691750 conn(0x7f649c09a230 msgr2=0x7f649c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 -- 172.21.15.119:0/832691750 shutdown_connections 2024-03-08T21:34:14.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 -- 172.21.15.119:0/832691750 wait complete. 2024-03-08T21:34:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.177+0000 7f64a1a00640 1 Processor -- start 2024-03-08T21:34:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- start start 2024-03-08T21:34:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f649c06c840 0x7f649c09cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f649c140fb0 0x7f649c09bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c152000 con 0x7f649c144030 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c06e190 con 0x7f649c140fb0 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c152180 con 0x7f649c06c840 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49836/0 (socket says 172.21.15.119:49836) 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 -- 172.21.15.119:0/3251857463 learned_addr learned my addr 172.21.15.119:0/3251857463 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649aa00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f649c06c840 0x7f649c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f6492000640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f649c140fb0 0x7f649c09bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 -- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f649c06c840 msgr2=0x7f649c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f649c06c840 0x7f649c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 -- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f649c140fb0 msgr2=0x7f649c09bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f649c140fb0 0x7f649c09bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 -- 172.21.15.119:0/3251857463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c099fe0 con 0x7f649c144030 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f649b400640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f649400c7d0 tx=0x7f649400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494017070 con 0x7f649c144030 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649400a640 con 0x7f649c144030 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c0b2c30 con 0x7f649c144030 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649400a9f0 con 0x7f649c144030 2024-03-08T21:34:14.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c06fd10 con 0x7f649c144030 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c067db0 con 0x7f649c144030 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.181+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f649401a070 con 0x7f649c144030 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.185+0000 7f6493400640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 0x7f6478069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.185+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6494084e00 con 0x7f649c144030 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.185+0000 7f649aa00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 0x7f6478069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.185+0000 7f649aa00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 0x7f6478069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f648c0ad000 tx=0x7f648c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.189+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f649c099fe0 con 0x7f649c144030 2024-03-08T21:34:14.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.341+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f649c0b8260 con 0x7f649c144030 2024-03-08T21:34:14.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f6493400640 1 -- 172.21.15.119:0/3251857463 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6494055420 con 0x7f649c144030 2024-03-08T21:34:14.332 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 msgr2=0x7f6478069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 0x7f6478069b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f648c0ad000 tx=0x7f648c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 msgr2=0x7f649c0b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f649400c7d0 tx=0x7f649400cc90 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 shutdown_connections 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6478067660 0x7f6478069b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f649c144030 0x7f649c0b1d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f649c140fb0 0x7f649c09bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 --2- 172.21.15.119:0/3251857463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f649c06c840 0x7f649c09cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 >> 172.21.15.119:0/3251857463 conn(0x7f649c09a230 msgr2=0x7f649c09a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 shutdown_connections 2024-03-08T21:34:14.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.345+0000 7f64a1a00640 1 -- 172.21.15.119:0/3251857463 wait complete. 2024-03-08T21:34:14.353 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T21:34:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 Processor -- start 2024-03-08T21:34:14.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 -- start start 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84e809adb0 0x7f84e809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e809b190 con 0x7f84e8072fe0 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e809d240 con 0x7f84e81448b0 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84f0600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e809d520 con 0x7f84e809adb0 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84e809adb0 0x7f84e809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84e809adb0 0x7f84e809cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49846/0 (socket says 172.21.15.119:49846) 2024-03-08T21:34:14.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 -- 172.21.15.119:0/1301529467 learned_addr learned my addr 172.21.15.119:0/1301529467 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 -- 172.21.15.119:0/1301529467 >> v1:172.21.15.160:6789/0 conn(0x7f84e81448b0 legacy=0x7f84e813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 -- 172.21.15.119:0/1301529467 >> v1:172.21.15.119:6789/0 conn(0x7f84e8072fe0 legacy=0x7f84e81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84edc00640 1 -- 172.21.15.119:0/1301529467 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e8143c50 con 0x7f84e809adb0 2024-03-08T21:34:14.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.505+0000 7f84e7e00640 1 -- 172.21.15.119:0/1301529467 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972113590 0 0) 0x7f84e809b190 con 0x7f84e8072fe0 2024-03-08T21:34:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84edc00640 1 --2- 172.21.15.119:0/1301529467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e809adb0 0x7f84e809cbf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009870 tx=0x7f84dc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c3543f5493e457 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84e7e00640 1 -- 172.21.15.119:0/1301529467 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0a9640 con 0x7f84e809adb0 2024-03-08T21:34:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84e7e00640 1 -- 172.21.15.119:0/1301529467 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc0a97e0 con 0x7f84e809adb0 2024-03-08T21:34:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84e7e00640 1 -- 172.21.15.119:0/1301529467 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0a9bb0 con 0x7f84e809adb0 2024-03-08T21:34:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- 172.21.15.119:0/1301529467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e809adb0 msgr2=0x7f84e809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 --2- 172.21.15.119:0/1301529467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e809adb0 0x7f84e809cbf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009870 tx=0x7f84dc01c560 comp rx=0 tx=0).stop 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- 172.21.15.119:0/1301529467 shutdown_connections 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 --2- 172.21.15.119:0/1301529467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e809adb0 0x7f84e809cbf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- 172.21.15.119:0/1301529467 >> 172.21.15.119:0/1301529467 conn(0x7f84e806c620 msgr2=0x7f84e806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- 172.21.15.119:0/1301529467 shutdown_connections 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- 172.21.15.119:0/1301529467 wait complete. 2024-03-08T21:34:14.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 Processor -- start 2024-03-08T21:34:14.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.509+0000 7f84f0600640 1 -- start start 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84e809adb0 0x7f84e81e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84e81448b0 0x7f84e813a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8152190 con 0x7f84e8072fe0 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8152010 con 0x7f84e81448b0 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8152310 con 0x7f84e809adb0 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49860/0 (socket says 172.21.15.119:49860) 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 -- 172.21.15.119:0/3608610820 learned_addr learned my addr 172.21.15.119:0/3608610820 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:14.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84ed200640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84e809adb0 0x7f84e81e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84ee600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84e81448b0 0x7f84e813a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 -- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84e809adb0 msgr2=0x7f84e81e0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84e809adb0 0x7f84e81e0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 -- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84e81448b0 msgr2=0x7f84e813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84e81448b0 0x7f84e813a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 -- 172.21.15.119:0/3608610820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e81e12a0 con 0x7f84e8072fe0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84edc00640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0ab040 tx=0x7f84dc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0b1c30 con 0x7f84e8072fe0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc0b1df0 con 0x7f84e8072fe0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0bc690 con 0x7f84e8072fe0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e80b25c0 con 0x7f84e8072fe0 2024-03-08T21:34:14.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80b0a30 con 0x7f84e8072fe0 2024-03-08T21:34:14.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e80aff00 con 0x7f84e8072fe0 2024-03-08T21:34:14.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.513+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f84dc0a95f0 con 0x7f84e8072fe0 2024-03-08T21:34:14.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.517+0000 7f84e5600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 0x7f84c8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.517+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84dc1203d0 con 0x7f84e8072fe0 2024-03-08T21:34:14.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.517+0000 7f84ed200640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 0x7f84c8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.517+0000 7f84ed200640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 0x7f84c8069b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84e813c620 tx=0x7f84d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.521+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f84dc0c3030 con 0x7f84e8072fe0 2024-03-08T21:34:14.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.685+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84e8067db0 con 0x7f84e8072fe0 2024-03-08T21:34:14.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.685+0000 7f84e5600640 1 -- 172.21.15.119:0/3608610820 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f84dc0ad020 con 0x7f84e8072fe0 2024-03-08T21:34:14.674 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 msgr2=0x7f84c8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 0x7f84c8069b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84e813c620 tx=0x7f84d4009040 comp rx=0 tx=0).stop 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 msgr2=0x7f84e80aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0ab040 tx=0x7f84dc01ada0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 shutdown_connections 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f84c8067690 0x7f84c8069b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84e81448b0 0x7f84e813a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84e809adb0 0x7f84e81e0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 --2- 172.21.15.119:0/3608610820 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e8072fe0 0x7f84e80aedf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 >> 172.21.15.119:0/3608610820 conn(0x7f84e806c620 msgr2=0x7f84e809a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 shutdown_connections 2024-03-08T21:34:14.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.689+0000 7f84f0600640 1 -- 172.21.15.119:0/3608610820 wait complete. 2024-03-08T21:34:14.694 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:14.694 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T21:34:14.704 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:14.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 Processor -- start 2024-03-08T21:34:14.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 -- start start 2024-03-08T21:34:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad680b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fad68072b30 0x7fad68151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad68072090 con 0x7fad680baea0 2024-03-08T21:34:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6806dd20 con 0x7fad68072b30 2024-03-08T21:34:14.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6da00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68147e40 con 0x7fad680b6c20 2024-03-08T21:34:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6d000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fad68072b30 0x7fad68151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad67e00640 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fad680baea0 0x7fad68147730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:53568/0 (socket says 172.21.15.119:53568) 2024-03-08T21:34:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad67e00640 1 -- 172.21.15.119:0/3976232849 learned_addr learned my addr 172.21.15.119:0/3976232849 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad5f400640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad680b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6d000640 1 -- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 msgr2=0x7fad680b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:14.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6d000640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad680b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6d000640 1 -- 172.21.15.119:0/3976232849 >> v1:172.21.15.160:6789/0 conn(0x7fad680baea0 legacy=0x7fad68147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.897+0000 7fad6d000640 1 -- 172.21.15.119:0/3976232849 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68072330 con 0x7fad68072b30 2024-03-08T21:34:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6d000640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68151770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad60009d90 tx=0x7fad6001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f0340e8812a1af2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad67400640 1 -- 172.21.15.119:0/3976232849 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600b4070 con 0x7fad68072b30 2024-03-08T21:34:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad67400640 1 -- 172.21.15.119:0/3976232849 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600af600 con 0x7fad68072b30 2024-03-08T21:34:14.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad67400640 1 -- 172.21.15.119:0/3976232849 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600af9d0 con 0x7fad68072b30 2024-03-08T21:34:14.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 msgr2=0x7fad68151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68151770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fad60009d90 tx=0x7fad6001f150 comp rx=0 tx=0).stop 2024-03-08T21:34:14.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- 172.21.15.119:0/3976232849 shutdown_connections 2024-03-08T21:34:14.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68151770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 --2- 172.21.15.119:0/3976232849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad680b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- 172.21.15.119:0/3976232849 >> 172.21.15.119:0/3976232849 conn(0x7fad6806b3b0 msgr2=0x7fad680ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:14.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- 172.21.15.119:0/3976232849 shutdown_connections 2024-03-08T21:34:14.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- 172.21.15.119:0/3976232849 wait complete. 2024-03-08T21:34:14.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 Processor -- start 2024-03-08T21:34:14.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.901+0000 7fad6da00640 1 -- start start 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad681d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad68071de0 con 0x7fad680baea0 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680bb280 con 0x7fad68072b30 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68146e90 con 0x7fad680b6c20 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49870/0 (socket says 172.21.15.119:49870) 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 -- 172.21.15.119:0/1555430861 learned_addr learned my addr 172.21.15.119:0/1555430861 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad67e00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad5f400640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad681d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 -- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 msgr2=0x7fad681d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad681d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 -- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 msgr2=0x7fad68147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 -- 172.21.15.119:0/1555430861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680b3580 con 0x7fad680baea0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad67e00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6d000640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad600b2040 tx=0x7fad6001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600bf020 con 0x7fad680baea0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad600ba470 con 0x7fad680baea0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680b3860 con 0x7fad680baea0 2024-03-08T21:34:14.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600b4040 con 0x7fad680baea0 2024-03-08T21:34:14.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680b4890 con 0x7fad680baea0 2024-03-08T21:34:14.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad680750f0 con 0x7fad680baea0 2024-03-08T21:34:14.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.905+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fad600c2020 con 0x7fad680baea0 2024-03-08T21:34:14.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.909+0000 7fad64c00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 0x7fad44069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:14.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.909+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad601244c0 con 0x7fad680baea0 2024-03-08T21:34:14.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.909+0000 7fad67e00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 0x7fad44069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:14.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.909+0000 7fad67e00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 0x7fad44069b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad58000f70 tx=0x7fad58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:14.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:14.913+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fad600c9030 con 0x7fad680baea0 2024-03-08T21:34:15.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.065+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad6806e070 con 0x7fad680baea0 2024-03-08T21:34:15.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.065+0000 7fad64c00640 1 -- 172.21.15.119:0/1555430861 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fad60018cb0 con 0x7fad680baea0 2024-03-08T21:34:15.055 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:15.055 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:15.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 msgr2=0x7fad44069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 0x7fad44069b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad58000f70 tx=0x7fad58009040 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 msgr2=0x7fad681df930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad600b2040 tx=0x7fad6001bef0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 shutdown_connections 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fad44067690 0x7fad44069b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad680baea0 0x7fad681df930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad680b6c20 0x7fad681d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 --2- 172.21.15.119:0/1555430861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad68072b30 0x7fad68147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 >> 172.21.15.119:0/1555430861 conn(0x7fad6806b3b0 msgr2=0x7fad68145000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 shutdown_connections 2024-03-08T21:34:15.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.069+0000 7fad6da00640 1 -- 172.21.15.119:0/1555430861 wait complete. 2024-03-08T21:34:15.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:15.076 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:15.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 Processor -- start 2024-03-08T21:34:15.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 -- start start 2024-03-08T21:34:15.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3a040b3c30 0x7f3a040b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a0406cb60 0x7f3a041451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a040b4e50 con 0x7f3a040b2d80 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040b54a0 con 0x7f3a040b3c30 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a08e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040b5130 con 0x7f3a0406cb60 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a02a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f3a040b2d80 0x7f3a0406c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33106/0 (socket says 172.21.15.119:33106) 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a02a00640 1 -- 172.21.15.119:0/2777440765 learned_addr learned my addr 172.21.15.119:0/2777440765 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a03400640 1 --2- 172.21.15.119:0/2777440765 >> v2:172.21.15.160:3300/0 conn(0x7f3a040b3c30 0x7f3a040b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a03e00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a0406cb60 0x7f3a041451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808029822 0 0) 0x7f3a040b4e50 con 0x7f3a040b2d80 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.225+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8003530 con 0x7f3a040b2d80 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 872732620 0 0) 0x7f39e8003530 con 0x7f3a040b2d80 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a0406cb60 msgr2=0x7f3a041451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a0406cb60 0x7f3a041451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 >> v2:172.21.15.160:3300/0 conn(0x7f3a040b3c30 msgr2=0x7f3a040b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 --2- 172.21.15.119:0/2777440765 >> v2:172.21.15.160:3300/0 conn(0x7f3a040b3c30 0x7f3a040b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040b3210 con 0x7f3a040b2d80 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f39f0001680 con 0x7f3a040b2d80 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 >> v1:172.21.15.119:6789/0 conn(0x7f3a040b2d80 legacy=0x7f3a0406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040b5130 con 0x7f39e80039c0 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800bf10 con 0x7f39e8004810 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e800c090 con 0x7f39e80051d0 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03e00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02a00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 -- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39e80051d0 msgr2=0x7f39e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 -- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8004810 msgr2=0x7f39e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 -- 172.21.15.119:0/2777440765 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8003530 con 0x7f39e80039c0 2024-03-08T21:34:15.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03e00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39e80051d0 0x7f39e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:15.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02a00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8004810 0x7f39e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a03400640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009fc0 tx=0x7f39f401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f29b8acdb9257d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f40b2070 con 0x7f39e80039c0 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.229+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f40a5bd0 con 0x7f39e80039c0 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02000640 1 -- 172.21.15.119:0/2777440765 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4009c10 con 0x7f39e80039c0 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/2777440765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e80039c0 msgr2=0x7f39e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 --2- 172.21.15.119:0/2777440765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39e80039c0 0x7f39e8003de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009fc0 tx=0x7f39f401ccc0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a03e00640 1 -- 172.21.15.119:0/2777440765 reap_dead start 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/2777440765 shutdown_connections 2024-03-08T21:34:15.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/2777440765 >> 172.21.15.119:0/2777440765 conn(0x7f3a040b8380 msgr2=0x7f3a040b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/2777440765 shutdown_connections 2024-03-08T21:34:15.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/2777440765 wait complete. 2024-03-08T21:34:15.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 Processor -- start 2024-03-08T21:34:15.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- start start 2024-03-08T21:34:15.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e80039c0 0x7f3a0413dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a041e2a70 0x7f3a041427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04145dd0 con 0x7f3a04143f40 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04145c50 con 0x7f39e80039c0 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04145f50 con 0x7f3a041e2a70 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49884/0 (socket says 172.21.15.119:49884) 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 -- 172.21.15.119:0/3300618071 learned_addr learned my addr 172.21.15.119:0/3300618071 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a03400640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e80039c0 0x7f3a0413dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a03e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a041e2a70 0x7f3a041427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 -- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a041e2a70 msgr2=0x7f3a041427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a041e2a70 0x7f3a041427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 -- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e80039c0 msgr2=0x7f3a0413dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e80039c0 0x7f3a0413dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 -- 172.21.15.119:0/3300618071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04144490 con 0x7f3a04143f40 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a02a00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000fc0 tx=0x7f39f000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f000c6c0 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f0018070 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.233+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a040af780 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f000cac0 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a041e2010 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a041e2210 con 0x7f3a04143f40 2024-03-08T21:34:15.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f39f000cc60 con 0x7f3a04143f40 2024-03-08T21:34:15.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f39fb400640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 0x7f39e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39f0085740 con 0x7f3a04143f40 2024-03-08T21:34:15.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f3a03400640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 0x7f39e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.237+0000 7f3a03400640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 0x7f39e4069b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f40af000 tx=0x7f39f40a7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.241+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f3a041e2210 con 0x7f3a04143f40 2024-03-08T21:34:15.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a04067db0 con 0x7f3a04143f40 2024-03-08T21:34:15.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f39fb400640 1 -- 172.21.15.119:0/3300618071 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39f0056330 con 0x7f3a04143f40 2024-03-08T21:34:15.385 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:15.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 msgr2=0x7f39e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 0x7f39e4069b20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f40af000 tx=0x7f39f40a7040 comp rx=0 tx=0).stop 2024-03-08T21:34:15.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 msgr2=0x7f3a041e2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000fc0 tx=0x7f39f000ec10 comp rx=0 tx=0).stop 2024-03-08T21:34:15.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 shutdown_connections 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f39e4067660 0x7f39e4069b20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a041e2a70 0x7f3a041427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a04143f40 0x7f3a041e2530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 --2- 172.21.15.119:0/3300618071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e80039c0 0x7f3a0413dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.397+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 >> 172.21.15.119:0/3300618071 conn(0x7f3a040b8380 msgr2=0x7f3a0406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.401+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 shutdown_connections 2024-03-08T21:34:15.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.401+0000 7f3a08e00640 1 -- 172.21.15.119:0/3300618071 wait complete. 2024-03-08T21:34:15.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:15.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 Processor -- start 2024-03-08T21:34:15.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 -- start start 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd640b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd640b6680 0x7fcd6406fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd640706a0 con 0x7fcd64070250 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6406c390 con 0x7fcd640b6680 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640b6ae0 con 0x7fcd64141320 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd640b6680 0x7fcd6406fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd640b6680 0x7fcd6406fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49898/0 (socket says 172.21.15.119:49898) 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd6a200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcd64070250 0x7fcd6406e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33114/0 (socket says 172.21.15.119:33114) 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 -- 172.21.15.119:0/1141235758 learned_addr learned my addr 172.21.15.119:0/1141235758 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd69800640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd640b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 -- 172.21.15.119:0/1141235758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 msgr2=0x7fcd640b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd640b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 -- 172.21.15.119:0/1141235758 >> v1:172.21.15.119:6789/0 conn(0x7fcd64070250 legacy=0x7fcd6406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd68e00640 1 -- 172.21.15.119:0/1141235758 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6406c0b0 con 0x7fcd640b6680 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd69800640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd640b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:15.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.557+0000 7fcd63e00640 1 -- 172.21.15.119:0/1141235758 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939387189 0 0) 0x7fcd640706a0 con 0x7fcd64070250 2024-03-08T21:34:15.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd68e00640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd6406fd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd500098a0 tx=0x7fcd5001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d7be6ec0d094a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd63e00640 1 -- 172.21.15.119:0/1141235758 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b0070 con 0x7fcd640b6680 2024-03-08T21:34:15.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd63e00640 1 -- 172.21.15.119:0/1141235758 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500ab600 con 0x7fcd640b6680 2024-03-08T21:34:15.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd63e00640 1 -- 172.21.15.119:0/1141235758 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500ab9d0 con 0x7fcd640b6680 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 -- 172.21.15.119:0/1141235758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 msgr2=0x7fcd6406fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd6406fd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd500098a0 tx=0x7fcd5001c540 comp rx=0 tx=0).stop 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 -- 172.21.15.119:0/1141235758 shutdown_connections 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd6406fd10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1141235758 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd640b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 -- 172.21.15.119:0/1141235758 >> 172.21.15.119:0/1141235758 conn(0x7fcd640b7230 msgr2=0x7fcd640b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 -- 172.21.15.119:0/1141235758 shutdown_connections 2024-03-08T21:34:15.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.561+0000 7fcd6c200640 1 -- 172.21.15.119:0/1141235758 wait complete. 2024-03-08T21:34:15.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 Processor -- start 2024-03-08T21:34:15.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- start start 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd64070250 0x7fcd6413b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd6413a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640b4bc0 con 0x7fcd640b6680 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd640b4a40 con 0x7fcd64070250 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64154810 con 0x7fcd64141320 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49910/0 (socket says 172.21.15.119:49910) 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 -- 172.21.15.119:0/1260000679 learned_addr learned my addr 172.21.15.119:0/1260000679 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:15.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd69800640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd64070250 0x7fcd6413b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6a200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd6413a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 -- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 msgr2=0x7fcd6413a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd6413a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 -- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd64070250 msgr2=0x7fcd6413b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd64070250 0x7fcd6413b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 -- 172.21.15.119:0/1260000679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd64139ed0 con 0x7fcd640b6680 2024-03-08T21:34:15.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd68e00640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ae040 tx=0x7fcd500192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b9070 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500b4400 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b0040 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6413c670 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6413ac40 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.565+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64067db0 con 0x7fcd640b6680 2024-03-08T21:34:15.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.569+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fcd500bc070 con 0x7fcd640b6680 2024-03-08T21:34:15.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.569+0000 7fcd61600640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 0x7fcd44069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.569+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd5011ea40 con 0x7fcd640b6680 2024-03-08T21:34:15.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.569+0000 7fcd69800640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 0x7fcd44069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.569+0000 7fcd69800640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 0x7fcd44069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd64138490 tx=0x7fcd58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.573+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fcd50016130 con 0x7fcd640b6680 2024-03-08T21:34:15.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.725+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd640b3b50 con 0x7fcd640b6680 2024-03-08T21:34:15.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.725+0000 7fcd61600640 1 -- 172.21.15.119:0/1260000679 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd500ef060 con 0x7fcd640b6680 2024-03-08T21:34:15.714 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 msgr2=0x7fcd44069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 0x7fcd44069b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcd64138490 tx=0x7fcd58008040 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 msgr2=0x7fcd640b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd500ae040 tx=0x7fcd500192e0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 shutdown_connections 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcd44067660 0x7fcd44069b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd64141320 0x7fcd6413a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd640b6680 0x7fcd640b2e50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 --2- 172.21.15.119:0/1260000679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd64070250 0x7fcd6413b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 >> 172.21.15.119:0/1260000679 conn(0x7fcd640b7230 msgr2=0x7fcd6413df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 shutdown_connections 2024-03-08T21:34:15.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.729+0000 7fcd6c200640 1 -- 172.21.15.119:0/1260000679 wait complete. 2024-03-08T21:34:15.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:15.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.881+0000 7f1b04800640 1 Processor -- start 2024-03-08T21:34:15.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 -- start start 2024-03-08T21:34:15.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1afc0b42b0 0x7f1afc06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1afc142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc06e0b0 con 0x7f1afc0b4690 2024-03-08T21:34:15.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc1456a0 con 0x7f1afc0b42b0 2024-03-08T21:34:15.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b04800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0b3850 con 0x7f1afc145b30 2024-03-08T21:34:15.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b02800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1afc0b4690 0x7f1afc1483b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33128/0 (socket says 172.21.15.119:33128) 2024-03-08T21:34:15.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b02800640 1 -- 172.21.15.119:0/2959397390 learned_addr learned my addr 172.21.15.119:0/2959397390 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01e00640 1 --2- 172.21.15.119:0/2959397390 >> v2:172.21.15.160:3300/0 conn(0x7f1afc0b42b0 0x7f1afc06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1afc142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176669352 0 0) 0x7f1afc06e0b0 con 0x7f1afc0b4690 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae4003530 con 0x7f1afc0b4690 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3741927275 0 0) 0x7f1ae4003530 con 0x7f1afc0b4690 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 msgr2=0x7f1afc142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1afc142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 >> v2:172.21.15.160:3300/0 conn(0x7f1afc0b42b0 msgr2=0x7f1afc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 --2- 172.21.15.119:0/2959397390 >> v2:172.21.15.160:3300/0 conn(0x7f1afc0b42b0 0x7f1afc06c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc145050 con 0x7f1afc0b4690 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f1af8001a00 con 0x7f1afc0b4690 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 >> v1:172.21.15.119:6789/0 conn(0x7f1afc0b4690 legacy=0x7f1afc1483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae40039c0 0x7f1ae4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ae4004810 0x7f1ae4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1ae40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc1456a0 con 0x7f1ae4004810 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0b3850 con 0x7f1ae40039c0 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae400b9d0 con 0x7f1afc145b30 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ae4004810 0x7f1ae4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01e00640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae40039c0 0x7f1ae4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b02800640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1ae40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 -- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 msgr2=0x7f1ae40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc145b30 0x7f1ae40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 -- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae40039c0 msgr2=0x7f1ae4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae40039c0 0x7f1ae4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.885+0000 7f1b01400640 1 -- 172.21.15.119:0/2959397390 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae4003530 con 0x7f1ae4004810 2024-03-08T21:34:15.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b01400640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ae4004810 0x7f1ae4004c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009ae0 tx=0x7f1aec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b60b7fd08390e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0096b0 con 0x7f1ae4004810 2024-03-08T21:34:15.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0b0400 con 0x7f1ae4004810 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b00a00640 1 -- 172.21.15.119:0/2959397390 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec0b07f0 con 0x7f1ae4004810 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 -- 172.21.15.119:0/2959397390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ae4004810 msgr2=0x7f1ae4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 --2- 172.21.15.119:0/2959397390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ae4004810 0x7f1ae4004c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009ae0 tx=0x7f1aec01ca30 comp rx=0 tx=0).stop 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b02800640 1 -- 172.21.15.119:0/2959397390 reap_dead start 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 -- 172.21.15.119:0/2959397390 shutdown_connections 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 -- 172.21.15.119:0/2959397390 >> 172.21.15.119:0/2959397390 conn(0x7f1afc09a230 msgr2=0x7f1afc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 -- 172.21.15.119:0/2959397390 shutdown_connections 2024-03-08T21:34:15.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.889+0000 7f1b04800640 1 -- 172.21.15.119:0/2959397390 wait complete. 2024-03-08T21:34:15.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 Processor -- start 2024-03-08T21:34:15.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- start start 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae4004810 0x7f1afc09bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc0b1a30 0x7f1afc0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc148e90 con 0x7f1afc13e820 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc148d10 con 0x7f1ae4004810 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc149010 con 0x7f1afc0b1a30 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49932/0 (socket says 172.21.15.119:49932) 2024-03-08T21:34:15.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 -- 172.21.15.119:0/2758239271 learned_addr learned my addr 172.21.15.119:0/2758239271 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01e00640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae4004810 0x7f1afc09bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b02800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc0b1a30 0x7f1afc0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 -- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc0b1a30 msgr2=0x7f1afc0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc0b1a30 0x7f1afc0b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 -- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae4004810 msgr2=0x7f1afc09bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae4004810 0x7f1afc09bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 -- 172.21.15.119:0/2758239271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0b1330 con 0x7f1afc13e820 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b01400640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1aec098230 tx=0x7f1aec0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec004020 con 0x7f1afc13e820 2024-03-08T21:34:15.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec0041e0 con 0x7f1afc13e820 2024-03-08T21:34:15.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc09cb80 con 0x7f1afc13e820 2024-03-08T21:34:15.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec003620 con 0x7f1afc13e820 2024-03-08T21:34:15.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc0b0150 con 0x7f1afc13e820 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.893+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc067db0 con 0x7f1afc13e820 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.897+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1aec0037c0 con 0x7f1afc13e820 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.897+0000 7f1af6000640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 0x7f1ae0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.897+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aec11f350 con 0x7f1afc13e820 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.897+0000 7f1b01e00640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 0x7f1ae0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:15.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.897+0000 7f1b01e00640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 0x7f1ae0069b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009c60 tx=0x7f1af0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:15.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:15.901+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1aec0ac030 con 0x7f1afc13e820 2024-03-08T21:34:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1afc09da10 con 0x7f1afc13e820 2024-03-08T21:34:16.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1af6000640 1 -- 172.21.15.119:0/2758239271 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1aec016780 con 0x7f1afc13e820 2024-03-08T21:34:16.041 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 msgr2=0x7f1ae0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 0x7f1ae0069b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009c60 tx=0x7f1af0009190 comp rx=0 tx=0).stop 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 msgr2=0x7f1afc13eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1aec098230 tx=0x7f1aec0197d0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 shutdown_connections 2024-03-08T21:34:16.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ae0067690 0x7f1ae0069b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1afc0b1a30 0x7f1afc0b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1afc13e820 0x7f1afc13eca0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 --2- 172.21.15.119:0/2758239271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ae4004810 0x7f1afc09bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.053+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 >> 172.21.15.119:0/2758239271 conn(0x7f1afc09a230 msgr2=0x7f1afc06cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.057+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 shutdown_connections 2024-03-08T21:34:16.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.057+0000 7f1b04800640 1 -- 172.21.15.119:0/2758239271 wait complete. 2024-03-08T21:34:16.063 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T21:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 Processor -- start 2024-03-08T21:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 -- start start 2024-03-08T21:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 0x7ff37c143640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff37c072920 0x7ff37c147600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 0x7ff37c140b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c146bb0 con 0x7ff37c072920 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c09be30 con 0x7ff37c1406c0 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff383e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b5ef0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff37c072920 0x7ff37c147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff37c072920 0x7ff37c147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49944/0 (socket says 172.21.15.119:49944) 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 -- 172.21.15.119:0/3862097435 learned_addr learned my addr 172.21.15.119:0/3862097435 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff381e00640 1 --2- 172.21.15.119:0/3862097435 >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 0x7ff37c140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 -- 172.21.15.119:0/3862097435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 msgr2=0x7ff37c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff381400640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 0x7ff37c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 0x7ff37c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 -- 172.21.15.119:0/3862097435 >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 msgr2=0x7ff37c140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 --2- 172.21.15.119:0/3862097435 >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 0x7ff37c140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff380a00640 1 -- 172.21.15.119:0/3862097435 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c146e00 con 0x7ff37c072920 2024-03-08T21:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff381e00640 1 --2- 172.21.15.119:0/3862097435 >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 0x7ff37c140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.209+0000 7ff381400640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 0x7ff37c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff380a00640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c072920 0x7ff37c147600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff37c06f620 tx=0x7ff36801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eadc066c7aeb3e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff37be00640 1 -- 172.21.15.119:0/3862097435 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680b0070 con 0x7ff37c072920 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff37be00640 1 -- 172.21.15.119:0/3862097435 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3680ab600 con 0x7ff37c072920 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff37be00640 1 -- 172.21.15.119:0/3862097435 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680ab9d0 con 0x7ff37c072920 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 -- 172.21.15.119:0/3862097435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c072920 msgr2=0x7ff37c147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c072920 0x7ff37c147600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff37c06f620 tx=0x7ff36801c3d0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 -- 172.21.15.119:0/3862097435 shutdown_connections 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 --2- 172.21.15.119:0/3862097435 >> v2:172.21.15.160:3300/0 conn(0x7ff37c1406c0 0x7ff37c140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c072920 0x7ff37c147600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 --2- 172.21.15.119:0/3862097435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c0b5b10 0x7ff37c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 -- 172.21.15.119:0/3862097435 >> 172.21.15.119:0/3862097435 conn(0x7ff37c06c620 msgr2=0x7ff37c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:16.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 -- 172.21.15.119:0/3862097435 shutdown_connections 2024-03-08T21:34:16.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.213+0000 7ff383e00640 1 -- 172.21.15.119:0/3862097435 wait complete. 2024-03-08T21:34:16.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 Processor -- start 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- start start 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff37c1406c0 0x7ff37c145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c1df2e0 0x7ff37c1e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b3460 con 0x7ff37c0b5b10 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b32e0 con 0x7ff37c1406c0 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b3f30 con 0x7ff37c1df2e0 2024-03-08T21:34:16.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49950/0 (socket says 172.21.15.119:49950) 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 -- 172.21.15.119:0/1501875143 learned_addr learned my addr 172.21.15.119:0/1501875143 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff380a00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff37c1406c0 0x7ff37c145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c1df2e0 0x7ff37c1e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 -- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c1df2e0 msgr2=0x7ff37c1e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c1df2e0 0x7ff37c1e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 -- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff37c1406c0 msgr2=0x7ff37c145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff37c1406c0 0x7ff37c145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 -- 172.21.15.119:0/1501875143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c1457b0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff381400640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff37000cf90 tx=0x7ff37000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37001a070 con 0x7ff37c0b5b10 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37000d840 con 0x7ff37c0b5b10 2024-03-08T21:34:16.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37000dc10 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c142060 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.217+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c141d80 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c067db0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff37001d070 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff379600640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 0x7ff35c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff370085ff0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff380a00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 0x7ff35c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.221+0000 7ff380a00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 0x7ff35c069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3680ad000 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.225+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff370056650 con 0x7ff37c0b5b10 2024-03-08T21:34:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.389+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff37c143bf0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.389+0000 7ff379600640 1 -- 172.21.15.119:0/1501875143 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff37005a6f0 con 0x7ff37c0b5b10 2024-03-08T21:34:16.378 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 msgr2=0x7ff35c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 0x7ff35c069b20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3680ad000 tx=0x7ff368008040 comp rx=0 tx=0).stop 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 msgr2=0x7ff37c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff37000cf90 tx=0x7ff37000a7d0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 shutdown_connections 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff35c067660 0x7ff35c069b20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff37c1df2e0 0x7ff37c1e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff37c1406c0 0x7ff37c145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 --2- 172.21.15.119:0/1501875143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff37c0b5b10 0x7ff37c13f450 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 >> 172.21.15.119:0/1501875143 conn(0x7ff37c06c620 msgr2=0x7ff37c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:16.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 shutdown_connections 2024-03-08T21:34:16.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.393+0000 7ff383e00640 1 -- 172.21.15.119:0/1501875143 wait complete. 2024-03-08T21:34:16.399 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-03-08T21:34:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:16.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:16.436 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:34:16.436 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:34:16.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:16.436 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-08T21:34:16.492 INFO:tasks.cephfs.cephfs_test_case:[] 2024-03-08T21:34:16.492 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:16.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 Processor -- start 2024-03-08T21:34:16.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 -- start start 2024-03-08T21:34:16.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f46cc09adb0 0x7f46cc09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46cc072fe0 0x7f46cc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc144b30 con 0x7f46cc1446e0 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc09b190 con 0x7f46cc072fe0 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46d2e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc09d240 con 0x7f46cc09adb0 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46cc072fe0 0x7f46cc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46cc072fe0 0x7f46cc1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49964/0 (socket says 172.21.15.119:49964) 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 -- 172.21.15.119:0/4069537960 learned_addr learned my addr 172.21.15.119:0/4069537960 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:16.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cbe00640 1 --2- 172.21.15.119:0/4069537960 >> v2:172.21.15.160:3300/0 conn(0x7f46cc09adb0 0x7f46cc09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 -- 172.21.15.119:0/4069537960 >> v2:172.21.15.160:3300/0 conn(0x7f46cc09adb0 msgr2=0x7f46cc09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:16.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 --2- 172.21.15.119:0/4069537960 >> v2:172.21.15.160:3300/0 conn(0x7f46cc09adb0 0x7f46cc09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 -- 172.21.15.119:0/4069537960 >> v1:172.21.15.160:6789/0 conn(0x7f46cc1446e0 legacy=0x7f46cc13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.681+0000 7f46cb400640 1 -- 172.21.15.119:0/4069537960 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc09d520 con 0x7f46cc072fe0 2024-03-08T21:34:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46cb400640 1 --2- 172.21.15.119:0/4069537960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc072fe0 0x7f46cc1441a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46cc06f120 tx=0x7f46b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6d37aad14389 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46caa00640 1 -- 172.21.15.119:0/4069537960 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80ab650 con 0x7f46cc072fe0 2024-03-08T21:34:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46caa00640 1 -- 172.21.15.119:0/4069537960 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b80b0070 con 0x7f46cc072fe0 2024-03-08T21:34:16.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46caa00640 1 -- 172.21.15.119:0/4069537960 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80aba10 con 0x7f46cc072fe0 2024-03-08T21:34:16.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 -- 172.21.15.119:0/4069537960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc072fe0 msgr2=0x7f46cc1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 --2- 172.21.15.119:0/4069537960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc072fe0 0x7f46cc1441a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46cc06f120 tx=0x7f46b801c430 comp rx=0 tx=0).stop 2024-03-08T21:34:16.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 -- 172.21.15.119:0/4069537960 shutdown_connections 2024-03-08T21:34:16.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 --2- 172.21.15.119:0/4069537960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc072fe0 0x7f46cc1441a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 --2- 172.21.15.119:0/4069537960 >> v2:172.21.15.160:3300/0 conn(0x7f46cc09adb0 0x7f46cc09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 -- 172.21.15.119:0/4069537960 >> 172.21.15.119:0/4069537960 conn(0x7f46cc06c620 msgr2=0x7f46cc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 -- 172.21.15.119:0/4069537960 shutdown_connections 2024-03-08T21:34:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.685+0000 7f46d2e00640 1 -- 172.21.15.119:0/4069537960 wait complete. 2024-03-08T21:34:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 Processor -- start 2024-03-08T21:34:16.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- start start 2024-03-08T21:34:16.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46cc072fe0 0x7f46cc13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46cc1446e0 0x7f46cc134770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc151180 con 0x7f46cc09adb0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc151000 con 0x7f46cc072fe0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc151300 con 0x7f46cc1446e0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cbe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46cc072fe0 0x7f46cc13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49978/0 (socket says 172.21.15.119:49978) 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 -- 172.21.15.119:0/2446112079 learned_addr learned my addr 172.21.15.119:0/2446112079 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d0e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46cc1446e0 0x7f46cc134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 -- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46cc1446e0 msgr2=0x7f46cc134770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46cc1446e0 0x7f46cc134770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 -- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46cc072fe0 msgr2=0x7f46cc13b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46cc072fe0 0x7f46cc13b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 -- 172.21.15.119:0/2446112079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc0b6ea0 con 0x7f46cc09adb0 2024-03-08T21:34:16.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46cb400640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46b801a0c0 tx=0x7f46b801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80be5f0 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b80be790 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b80beb60 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc0b7180 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc0b6320 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.689+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc067db0 con 0x7f46cc09adb0 2024-03-08T21:34:16.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.693+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f46b80b43f0 con 0x7f46cc09adb0 2024-03-08T21:34:16.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.693+0000 7f46c3e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 0x7f46ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:16.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.693+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46b81204f0 con 0x7f46cc09adb0 2024-03-08T21:34:16.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.693+0000 7f46cbe00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 0x7f46ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:16.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.693+0000 7f46cbe00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 0x7f46ac069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009b60 tx=0x7f46bc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:16.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.697+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f46b8016110 con 0x7f46cc09adb0 2024-03-08T21:34:16.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.881+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46cc1374a0 con 0x7f46cc09adb0 2024-03-08T21:34:16.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46c3e00640 1 -- 172.21.15.119:0/2446112079 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7f46b80f0c30 con 0x7f46cc09adb0 2024-03-08T21:34:16.872 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:16.872 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 msgr2=0x7f46ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 0x7f46ac069b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009b60 tx=0x7f46bc009190 comp rx=0 tx=0).stop 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 msgr2=0x7f46cc1e2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46b801a0c0 tx=0x7f46b801acd0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 shutdown_connections 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f46ac067660 0x7f46ac069b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f46cc1446e0 0x7f46cc134770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46cc09adb0 0x7f46cc1e2e80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 --2- 172.21.15.119:0/2446112079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46cc072fe0 0x7f46cc13b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:16.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 >> 172.21.15.119:0/2446112079 conn(0x7f46cc06c620 msgr2=0x7f46cc06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:16.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 shutdown_connections 2024-03-08T21:34:16.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:16.885+0000 7f46d2e00640 1 -- 172.21.15.119:0/2446112079 wait complete. 2024-03-08T21:34:16.893 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 Processor -- start 2024-03-08T21:34:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 -- start start 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efd681448b0 0x7efd6809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6809b190 con 0x7efd6809adb0 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6809d240 con 0x7efd68072fe0 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6f000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6809d520 con 0x7efd681448b0 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd67e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7efd6809adb0 0x7efd681441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33136/0 (socket says 172.21.15.119:33136) 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd67e00640 1 -- 172.21.15.119:0/1797345010 learned_addr learned my addr 172.21.15.119:0/1797345010 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.037+0000 7efd6d000640 1 --2- 172.21.15.119:0/1797345010 >> v2:172.21.15.119:3300/0 conn(0x7efd681448b0 0x7efd6809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd66a00640 1 -- 172.21.15.119:0/1797345010 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801830532 0 0) 0x7efd6809b190 con 0x7efd6809adb0 2024-03-08T21:34:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd66a00640 1 -- 172.21.15.119:0/1797345010 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c003530 con 0x7efd6809adb0 2024-03-08T21:34:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6d000640 1 -- 172.21.15.119:0/1797345010 >> v1:172.21.15.160:6789/0 conn(0x7efd68072fe0 legacy=0x7efd6813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6d000640 1 -- 172.21.15.119:0/1797345010 >> v1:172.21.15.119:6789/0 conn(0x7efd6809adb0 legacy=0x7efd681441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6d000640 1 -- 172.21.15.119:0/1797345010 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68143c50 con 0x7efd681448b0 2024-03-08T21:34:17.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6d000640 1 --2- 172.21.15.119:0/1797345010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd681448b0 0x7efd6809cbf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd600097c0 tx=0x7efd6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69293ce18014b1cc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd66a00640 1 -- 172.21.15.119:0/1797345010 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600aa620 con 0x7efd681448b0 2024-03-08T21:34:17.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd66a00640 1 -- 172.21.15.119:0/1797345010 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600af070 con 0x7efd681448b0 2024-03-08T21:34:17.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd66a00640 1 -- 172.21.15.119:0/1797345010 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600aa9c0 con 0x7efd681448b0 2024-03-08T21:34:17.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 -- 172.21.15.119:0/1797345010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd681448b0 msgr2=0x7efd6809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 --2- 172.21.15.119:0/1797345010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd681448b0 0x7efd6809cbf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd600097c0 tx=0x7efd6001c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 -- 172.21.15.119:0/1797345010 shutdown_connections 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 --2- 172.21.15.119:0/1797345010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd681448b0 0x7efd6809cbf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 -- 172.21.15.119:0/1797345010 >> 172.21.15.119:0/1797345010 conn(0x7efd6806c620 msgr2=0x7efd6806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 -- 172.21.15.119:0/1797345010 shutdown_connections 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.041+0000 7efd6f000640 1 -- 172.21.15.119:0/1797345010 wait complete. 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 Processor -- start 2024-03-08T21:34:17.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- start start 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd68072fe0 0x7efd680ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd681448b0 0x7efd681e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68152190 con 0x7efd6809adb0 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68152010 con 0x7efd68072fe0 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd68152310 con 0x7efd681448b0 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49992/0 (socket says 172.21.15.119:49992) 2024-03-08T21:34:17.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 -- 172.21.15.119:0/3384943871 learned_addr learned my addr 172.21.15.119:0/3384943871 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67e00640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd68072fe0 0x7efd680ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6d000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd681448b0 0x7efd681e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 -- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd681448b0 msgr2=0x7efd681e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd681448b0 0x7efd681e0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 -- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd68072fe0 msgr2=0x7efd680ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd68072fe0 0x7efd680ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 -- 172.21.15.119:0/3384943871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680717c0 con 0x7efd6809adb0 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd67400640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c460 tx=0x7efd5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54016020 con 0x7efd6809adb0 2024-03-08T21:34:17.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540052d0 con 0x7efd6809adb0 2024-03-08T21:34:17.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6813be90 con 0x7efd6809adb0 2024-03-08T21:34:17.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54007260 con 0x7efd6809adb0 2024-03-08T21:34:17.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.045+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6806f860 con 0x7efd6809adb0 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd68067db0 con 0x7efd6809adb0 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7efd54007400 con 0x7efd6809adb0 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd5fe00640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 0x7efd48069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd54085250 con 0x7efd6809adb0 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd67e00640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 0x7efd48069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.049+0000 7efd67e00640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 0x7efd48069b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd58001570 tx=0x7efd58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.053+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7efd54020020 con 0x7efd6809adb0 2024-03-08T21:34:17.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.205+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd6813bc60 con 0x7efd6809adb0 2024-03-08T21:34:17.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd5fe00640 1 -- 172.21.15.119:0/3384943871 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7efd54005480 con 0x7efd6809adb0 2024-03-08T21:34:17.196 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:17.196 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:17.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 msgr2=0x7efd48069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 0x7efd48069b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efd58001570 tx=0x7efd58009040 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 msgr2=0x7efd6806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c460 tx=0x7efd5400c920 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 shutdown_connections 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7efd48067690 0x7efd48069b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd681448b0 0x7efd681e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd6809adb0 0x7efd6806fe00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 --2- 172.21.15.119:0/3384943871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd68072fe0 0x7efd680ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 >> 172.21.15.119:0/3384943871 conn(0x7efd6806c620 msgr2=0x7efd6813d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 shutdown_connections 2024-03-08T21:34:17.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.209+0000 7efd6f000640 1 -- 172.21.15.119:0/3384943871 wait complete. 2024-03-08T21:34:17.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:33:46.391731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:33:47.679209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:17.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:17.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.365+0000 7fd01d200640 1 Processor -- start 2024-03-08T21:34:17.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.365+0000 7fd01d200640 1 -- start start 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd01d200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0180b42b0 0x7fd01806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd01d200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01806e0b0 con 0x7fd018145b30 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd01d200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd018145050 con 0x7fd0180b4690 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd01d200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd018142a90 con 0x7fd0180b42b0 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0180b42b0 0x7fd01806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd00d400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd018145b30 0x7fd018142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33148/0 (socket says 172.21.15.119:33148) 2024-03-08T21:34:17.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd00d400640 1 -- 172.21.15.119:0/1472225678 learned_addr learned my addr 172.21.15.119:0/1472225678 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015400640 1 -- 172.21.15.119:0/1472225678 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843204686 0 0) 0x7fd01806e0b0 con 0x7fd018145b30 2024-03-08T21:34:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015400640 1 -- 172.21.15.119:0/1472225678 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcffc003530 con 0x7fd018145b30 2024-03-08T21:34:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015e00640 1 -- 172.21.15.119:0/1472225678 >> v1:172.21.15.160:6789/0 conn(0x7fd0180b4690 legacy=0x7fd01814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015e00640 1 -- 172.21.15.119:0/1472225678 >> v1:172.21.15.119:6789/0 conn(0x7fd018145b30 legacy=0x7fd018142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015e00640 1 -- 172.21.15.119:0/1472225678 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018145330 con 0x7fd0180b42b0 2024-03-08T21:34:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.369+0000 7fd015e00640 1 --2- 172.21.15.119:0/1472225678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b42b0 0x7fd01806c5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd00801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab389c6876696c87 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd015400640 1 -- 172.21.15.119:0/1472225678 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080b2070 con 0x7fd0180b42b0 2024-03-08T21:34:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd015400640 1 -- 172.21.15.119:0/1472225678 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0080a57a0 con 0x7fd0180b42b0 2024-03-08T21:34:17.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd015400640 1 -- 172.21.15.119:0/1472225678 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080a5b70 con 0x7fd0180b42b0 2024-03-08T21:34:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- 172.21.15.119:0/1472225678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b42b0 msgr2=0x7fd01806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 --2- 172.21.15.119:0/1472225678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b42b0 0x7fd01806c5e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd008009d90 tx=0x7fd00801c8e0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- 172.21.15.119:0/1472225678 shutdown_connections 2024-03-08T21:34:17.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 --2- 172.21.15.119:0/1472225678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b42b0 0x7fd01806c5e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- 172.21.15.119:0/1472225678 >> 172.21.15.119:0/1472225678 conn(0x7fd01809a230 msgr2=0x7fd01809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- 172.21.15.119:0/1472225678 shutdown_connections 2024-03-08T21:34:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- 172.21.15.119:0/1472225678 wait complete. 2024-03-08T21:34:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 Processor -- start 2024-03-08T21:34:17.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- start start 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0180b42b0 0x7fd01813cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd018145b30 0x7fd0181e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018153830 con 0x7fd0180b4690 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180b3850 con 0x7fd018145b30 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd01d200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181539b0 con 0x7fd0180b42b0 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd00d400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd00d400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:49996/0 (socket says 172.21.15.119:49996) 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd00d400640 1 -- 172.21.15.119:0/536405603 learned_addr learned my addr 172.21.15.119:0/536405603 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:17.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd016800640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd018145b30 0x7fd0181e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.373+0000 7fd015e00640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0180b42b0 0x7fd01813cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 -- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0180b42b0 msgr2=0x7fd01813cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0180b42b0 0x7fd01813cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 -- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd018145b30 msgr2=0x7fd0181e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd018145b30 0x7fd0181e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 -- 172.21.15.119:0/536405603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018137400 con 0x7fd0180b4690 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00d400640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd000001ec0 tx=0x7fd00000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000017070 con 0x7fd0180b4690 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd000005d50 con 0x7fd0180b4690 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01813c200 con 0x7fd0180b4690 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000007270 con 0x7fd0180b4690 2024-03-08T21:34:17.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018137080 con 0x7fd0180b4690 2024-03-08T21:34:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd018067db0 con 0x7fd0180b4690 2024-03-08T21:34:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd00001a070 con 0x7fd0180b4690 2024-03-08T21:34:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 0x7fcff4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd000084b70 con 0x7fd0180b4690 2024-03-08T21:34:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.377+0000 7fd015e00640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 0x7fcff4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.381+0000 7fd015e00640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 0x7fcff4069b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0080af000 tx=0x7fd0080a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.381+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd0000552f0 con 0x7fd0180b4690 2024-03-08T21:34:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd018139e20 con 0x7fd0180b4690 2024-03-08T21:34:17.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd00ea00640 1 -- 172.21.15.119:0/536405603 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd000059390 con 0x7fd0180b4690 2024-03-08T21:34:17.530 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 msgr2=0x7fcff4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 0x7fcff4069b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd0080af000 tx=0x7fd0080a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 msgr2=0x7fd0180aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd000001ec0 tx=0x7fd00000c960 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 shutdown_connections 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fcff4067660 0x7fcff4069b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd018145b30 0x7fd0181e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0180b4690 0x7fd0180aef60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 --2- 172.21.15.119:0/536405603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0180b42b0 0x7fd01813cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.541+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 >> 172.21.15.119:0/536405603 conn(0x7fd01809a230 msgr2=0x7fd018142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.545+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 shutdown_connections 2024-03-08T21:34:17.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.545+0000 7fd01d200640 1 -- 172.21.15.119:0/536405603 wait complete. 2024-03-08T21:34:17.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:17.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 Processor -- start 2024-03-08T21:34:17.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 -- start start 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff0fc066d30 0x7ff0fc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 0x7ff0fc143f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0ae740 con 0x7ff0fc1444a0 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc067110 con 0x7ff0fc066d30 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff102200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b4320 con 0x7ff0fc0af380 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fbe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff0fc1444a0 0x7ff0fc09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33160/0 (socket says 172.21.15.119:33160) 2024-03-08T21:34:17.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fbe00640 1 -- 172.21.15.119:0/790196413 learned_addr learned my addr 172.21.15.119:0/790196413 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0f3e00640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 0x7ff0fc143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fb400640 1 --2- 172.21.15.119:0/790196413 >> v2:172.21.15.160:3300/0 conn(0x7ff0fc066d30 0x7ff0fc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945714715 0 0) 0x7ff0fc0ae740 con 0x7ff0fc1444a0 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e0003530 con 0x7ff0fc1444a0 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744371842 0 0) 0x7ff0e0003530 con 0x7ff0fc1444a0 2024-03-08T21:34:17.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fb400640 1 -- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 msgr2=0x7ff0fc143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fb400640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 0x7ff0fc143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fb400640 1 -- 172.21.15.119:0/790196413 >> v1:172.21.15.119:6789/0 conn(0x7ff0fc1444a0 legacy=0x7ff0fc09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0fb400640 1 -- 172.21.15.119:0/790196413 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b4c20 con 0x7ff0fc066d30 2024-03-08T21:34:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.701+0000 7ff0f3e00640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 0x7ff0fc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff0fb400640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc066d30 0x7ff0fc0aee40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0097c0 tx=0x7ff0ec01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c35cfc230f2300 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0b0070 con 0x7ff0fc066d30 2024-03-08T21:34:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0ab400 con 0x7ff0fc066d30 2024-03-08T21:34:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff0faa00640 1 -- 172.21.15.119:0/790196413 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4001a00 con 0x7ff0fc066d30 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc066d30 msgr2=0x7ff0fc0aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc066d30 0x7ff0fc0aee40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0097c0 tx=0x7ff0ec01c3c0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- 172.21.15.119:0/790196413 shutdown_connections 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc0af380 0x7ff0fc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 --2- 172.21.15.119:0/790196413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc066d30 0x7ff0fc0aee40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- 172.21.15.119:0/790196413 >> 172.21.15.119:0/790196413 conn(0x7ff0fc0b5770 msgr2=0x7ff0fc0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- 172.21.15.119:0/790196413 shutdown_connections 2024-03-08T21:34:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- 172.21.15.119:0/790196413 wait complete. 2024-03-08T21:34:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 Processor -- start 2024-03-08T21:34:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.705+0000 7ff102200640 1 -- start start 2024-03-08T21:34:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc066d30 0x7ff0fc0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc1444a0 0x7ff0fc1e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0af760 con 0x7ff0fc0af380 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc144910 con 0x7ff0fc1444a0 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc13e080 con 0x7ff0fc066d30 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50012/0 (socket says 172.21.15.119:50012) 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 -- 172.21.15.119:0/3192490476 learned_addr learned my addr 172.21.15.119:0/3192490476 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0fbe00640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc1444a0 0x7ff0fc1e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0fb400640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc066d30 0x7ff0fc0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 -- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc066d30 msgr2=0x7ff0fc0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc066d30 0x7ff0fc0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 -- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc1444a0 msgr2=0x7ff0fc1e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc1444a0 0x7ff0fc1e3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 -- 172.21.15.119:0/3192490476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc13efd0 con 0x7ff0fc0af380 2024-03-08T21:34:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3e00640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400ec10 tx=0x7ff0e400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4017070 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400cc30 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4013470 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc13cc00 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc1525b0 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.709+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc067db0 con 0x7ff0fc0af380 2024-03-08T21:34:17.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.713+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff0e401a070 con 0x7ff0fc0af380 2024-03-08T21:34:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.713+0000 7ff0f3400640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 0x7ff0d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.713+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0e4085ad0 con 0x7ff0fc0af380 2024-03-08T21:34:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.713+0000 7ff0fb400640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 0x7ff0d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:17.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.713+0000 7ff0fb400640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 0x7ff0d8069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0ad000 tx=0x7ff0ec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:17.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.717+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff0e4056170 con 0x7ff0fc0af380 2024-03-08T21:34:17.755 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:34:17.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:34:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.877+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0fc0ae3f0 con 0x7ff0fc0af380 2024-03-08T21:34:17.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.877+0000 7ff0f3400640 1 -- 172.21.15.119:0/3192490476 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0e405a210 con 0x7ff0fc0af380 2024-03-08T21:34:17.866 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:17.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 msgr2=0x7ff0d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 0x7ff0d8069b20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0ad000 tx=0x7ff0ec0a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:17.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 msgr2=0x7ff0fc1e2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:17.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400ec10 tx=0x7ff0e400c520 comp rx=0 tx=0).stop 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 shutdown_connections 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0d8067660 0x7ff0d8069b20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0fc1444a0 0x7ff0fc1e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0fc0af380 0x7ff0fc1e2d00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 --2- 172.21.15.119:0/3192490476 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0fc066d30 0x7ff0fc0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 >> 172.21.15.119:0/3192490476 conn(0x7ff0fc0b5770 msgr2=0x7ff0fc073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 shutdown_connections 2024-03-08T21:34:17.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:17.881+0000 7ff102200640 1 -- 172.21.15.119:0/3192490476 wait complete. 2024-03-08T21:34:17.888 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:18.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 Processor -- start 2024-03-08T21:34:18.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 -- start start 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7ccc06c840 0x7f7ccc0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc140fb0 0x7f7ccc1413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc06cc20 con 0x7f7ccc144030 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ccc0b3670 con 0x7f7ccc06c840 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd3400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc0b3950 con 0x7f7ccc140fb0 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cc3e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7ccc144030 0x7f7ccc1444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33164/0 (socket says 172.21.15.119:33164) 2024-03-08T21:34:18.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cc3e00640 1 -- 172.21.15.119:0/2208553905 learned_addr learned my addr 172.21.15.119:0/2208553905 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/2208553905 >> v2:172.21.15.160:3300/0 conn(0x7f7ccc06c840 0x7f7ccc0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7ccbe00640 1 -- 172.21.15.119:0/2208553905 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 996220668 0 0) 0x7f7ccc06cc20 con 0x7f7ccc144030 2024-03-08T21:34:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd1400640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc140fb0 0x7f7ccc1413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7ccbe00640 1 -- 172.21.15.119:0/2208553905 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb0005740 con 0x7f7ccc144030 2024-03-08T21:34:18.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd0a00640 1 -- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc140fb0 msgr2=0x7f7ccc1413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:18.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc140fb0 0x7f7ccc1413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd0a00640 1 -- 172.21.15.119:0/2208553905 >> v1:172.21.15.119:6789/0 conn(0x7f7ccc144030 legacy=0x7f7ccc1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.037+0000 7f7cd0a00640 1 -- 172.21.15.119:0/2208553905 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc141920 con 0x7f7ccc06c840 2024-03-08T21:34:18.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc06c840 0x7f7ccc0b3090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097c0 tx=0x7f7cbc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df58fe4d99dee223 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7ccbe00640 1 -- 172.21.15.119:0/2208553905 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b0070 con 0x7f7ccc06c840 2024-03-08T21:34:18.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7ccbe00640 1 -- 172.21.15.119:0/2208553905 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0ab600 con 0x7f7ccc06c840 2024-03-08T21:34:18.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7ccbe00640 1 -- 172.21.15.119:0/2208553905 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0ab9d0 con 0x7f7ccc06c840 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 -- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc06c840 msgr2=0x7f7ccc0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc06c840 0x7f7ccc0b3090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0097c0 tx=0x7f7cbc01c410 comp rx=0 tx=0).stop 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 -- 172.21.15.119:0/2208553905 shutdown_connections 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc140fb0 0x7f7ccc1413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 --2- 172.21.15.119:0/2208553905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc06c840 0x7f7ccc0b3090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 -- 172.21.15.119:0/2208553905 >> 172.21.15.119:0/2208553905 conn(0x7f7ccc09a230 msgr2=0x7f7ccc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 -- 172.21.15.119:0/2208553905 shutdown_connections 2024-03-08T21:34:18.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.041+0000 7f7cd3400640 1 -- 172.21.15.119:0/2208553905 wait complete. 2024-03-08T21:34:18.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 Processor -- start 2024-03-08T21:34:18.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- start start 2024-03-08T21:34:18.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 0x7f7ccc1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc140fb0 0x7f7ccc1dbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06da10 con 0x7f7ccc144030 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06d890 con 0x7f7ccc140fb0 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ccc06db90 con 0x7f7ccc06c840 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50022/0 (socket says 172.21.15.119:50022) 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 -- 172.21.15.119:0/846429166 learned_addr learned my addr 172.21.15.119:0/846429166 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cc3e00640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc140fb0 0x7f7ccc1dbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 0x7f7ccc1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 -- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 msgr2=0x7f7ccc1479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 0x7f7ccc1479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 -- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc140fb0 msgr2=0x7f7ccc1dbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc140fb0 0x7f7ccc1dbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 -- 172.21.15.119:0/846429166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0706c0 con 0x7f7ccc144030 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 0x7f7ccc1479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd1400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4007e70 tx=0x7f7cc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4014620 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc4019070 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4014a20 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc0709a0 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.045+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc070e30 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ccc067db0 con 0x7f7ccc144030 2024-03-08T21:34:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7cc4014bc0 con 0x7f7ccc144030 2024-03-08T21:34:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cc9600640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 0x7f7ca8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cc40860f0 con 0x7f7ccc144030 2024-03-08T21:34:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 0x7f7ca8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.049+0000 7f7cd0a00640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 0x7f7ca8069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0ad000 tx=0x7f7cbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.053+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7cc4056d60 con 0x7f7ccc144030 2024-03-08T21:34:18.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.209+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ccc0b8260 con 0x7f7ccc144030 2024-03-08T21:34:18.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.209+0000 7f7cc9600640 1 -- 172.21.15.119:0/846429166 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cc4056660 con 0x7f7ccc144030 2024-03-08T21:34:18.199 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:18.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 msgr2=0x7f7ca8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 0x7f7ca8069b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0ad000 tx=0x7f7cbc008040 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 msgr2=0x7f7ccc06fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4007e70 tx=0x7f7cc400e4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 shutdown_connections 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7ca8067690 0x7f7ca8069b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ccc144030 0x7f7ccc06fbd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ccc140fb0 0x7f7ccc1dbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 --2- 172.21.15.119:0/846429166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ccc06c840 0x7f7ccc1479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 >> 172.21.15.119:0/846429166 conn(0x7f7ccc09a230 msgr2=0x7f7ccc1444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 shutdown_connections 2024-03-08T21:34:18.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.213+0000 7f7cd3400640 1 -- 172.21.15.119:0/846429166 wait complete. 2024-03-08T21:34:18.221 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:18.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.365+0000 7fab3c600640 1 Processor -- start 2024-03-08T21:34:18.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.365+0000 7fab3c600640 1 -- start start 2024-03-08T21:34:18.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3c600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fab340b4f40 0x7fab3406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3c600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab34072410 0x7fab34143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3c600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab340ae4d0 con 0x7fab34144410 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3c600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab340ae740 con 0x7fab34072410 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3c600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab34066e00 con 0x7fab340b4f40 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab34072410 0x7fab34143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3a600640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fab34144410 0x7fab3414a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33168/0 (socket says 172.21.15.119:33168) 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab3a600640 1 -- 172.21.15.119:0/1374012992 learned_addr learned my addr 172.21.15.119:0/1374012992 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39c00640 1 --2- 172.21.15.119:0/1374012992 >> v2:172.21.15.160:3300/0 conn(0x7fab340b4f40 0x7fab3406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39200640 1 -- 172.21.15.119:0/1374012992 >> v2:172.21.15.160:3300/0 conn(0x7fab340b4f40 msgr2=0x7fab3406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39200640 1 --2- 172.21.15.119:0/1374012992 >> v2:172.21.15.160:3300/0 conn(0x7fab340b4f40 0x7fab3406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39200640 1 -- 172.21.15.119:0/1374012992 >> v1:172.21.15.119:6789/0 conn(0x7fab34144410 legacy=0x7fab3414a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab39200640 1 -- 172.21.15.119:0/1374012992 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340b5320 con 0x7fab34072410 2024-03-08T21:34:18.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.369+0000 7fab33e00640 1 -- 172.21.15.119:0/1374012992 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386069288 0 0) 0x7fab340ae4d0 con 0x7fab34144410 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 --2- 172.21.15.119:0/1374012992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab34072410 0x7fab34143ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fab3406ecc0 tx=0x7fab2001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d721cf8efcff997f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab33e00640 1 -- 172.21.15.119:0/1374012992 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200b5070 con 0x7fab34072410 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab33e00640 1 -- 172.21.15.119:0/1374012992 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200a8970 con 0x7fab34072410 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab33e00640 1 -- 172.21.15.119:0/1374012992 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200a8d40 con 0x7fab34072410 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- 172.21.15.119:0/1374012992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab34072410 msgr2=0x7fab34143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- 172.21.15.119:0/1374012992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab34072410 0x7fab34143ed0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fab3406ecc0 tx=0x7fab2001ec70 comp rx=0 tx=0).stop 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- 172.21.15.119:0/1374012992 shutdown_connections 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- 172.21.15.119:0/1374012992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab34072410 0x7fab34143ed0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- 172.21.15.119:0/1374012992 >> v2:172.21.15.160:3300/0 conn(0x7fab340b4f40 0x7fab3406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- 172.21.15.119:0/1374012992 >> 172.21.15.119:0/1374012992 conn(0x7fab340b5870 msgr2=0x7fab340b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- 172.21.15.119:0/1374012992 shutdown_connections 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- 172.21.15.119:0/1374012992 wait complete. 2024-03-08T21:34:18.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 Processor -- start 2024-03-08T21:34:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- start start 2024-03-08T21:34:18.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab34072410 0x7fab34148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 0x7fab341e0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3406e340 con 0x7fab340b4f40 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340aff10 con 0x7fab34072410 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3c600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3406e4c0 con 0x7fab34144410 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50042/0 (socket says 172.21.15.119:50042) 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 -- 172.21.15.119:0/399951189 learned_addr learned my addr 172.21.15.119:0/399951189 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39c00640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab34072410 0x7fab34148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3a600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 0x7fab341e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 -- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 msgr2=0x7fab341e0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 0x7fab341e0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 -- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab34072410 msgr2=0x7fab34148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab34072410 0x7fab34148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab39200640 1 -- 172.21.15.119:0/399951189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab341494e0 con 0x7fab340b4f40 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.373+0000 7fab3a600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 0x7fab341e0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab39200640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab200b3040 tx=0x7fab2001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200bf070 con 0x7fab340b4f40 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200b0640 con 0x7fab340b4f40 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab341497c0 con 0x7fab340b4f40 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200b5040 con 0x7fab340b4f40 2024-03-08T21:34:18.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab34070a30 con 0x7fab340b4f40 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab34070d20 con 0x7fab340b4f40 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fab200c2070 con 0x7fab340b4f40 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 0x7fab14069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab20121f30 con 0x7fab340b4f40 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab39c00640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 0x7fab14069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.377+0000 7fab39c00640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 0x7fab14069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab3413ec10 tx=0x7fab2800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.381+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fab200187d0 con 0x7fab340b4f40 2024-03-08T21:34:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.569+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab34067db0 con 0x7fab340b4f40 2024-03-08T21:34:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.569+0000 7fab31600640 1 -- 172.21.15.119:0/399951189 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7fab200f25d0 con 0x7fab340b4f40 2024-03-08T21:34:18.559 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:18.559 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 msgr2=0x7fab14069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 0x7fab14069b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab3413ec10 tx=0x7fab2800b040 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 msgr2=0x7fab341dff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab200b3040 tx=0x7fab2001ba10 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 shutdown_connections 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fab14067660 0x7fab14069b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab34144410 0x7fab341e0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab340b4f40 0x7fab341dff20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 --2- 172.21.15.119:0/399951189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab34072410 0x7fab34148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 >> 172.21.15.119:0/399951189 conn(0x7fab340b5870 msgr2=0x7fab34073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 shutdown_connections 2024-03-08T21:34:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.573+0000 7fab3c600640 1 -- 172.21.15.119:0/399951189 wait complete. 2024-03-08T21:34:18.580 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:18.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 Processor -- start 2024-03-08T21:34:18.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 -- start start 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f54099ca0 0x7f5f5413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5f5409afe0 0x7f5f540b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5409a080 con 0x7f5f5413f2c0 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540b4b60 con 0x7f5f54099ca0 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f59600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540b4510 con 0x7f5f5409afe0 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f52a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f54099ca0 0x7f5f5413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f52000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5f5413f2c0 0x7f5f5409a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33170/0 (socket says 172.21.15.119:33170) 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.725+0000 7f5f52000640 1 -- 172.21.15.119:0/3617874063 learned_addr learned my addr 172.21.15.119:0/3617874063 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f53400640 1 --2- 172.21.15.119:0/3617874063 >> v2:172.21.15.160:3300/0 conn(0x7f5f5409afe0 0x7f5f540b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f52a00640 1 -- 172.21.15.119:0/3617874063 >> v2:172.21.15.160:3300/0 conn(0x7f5f5409afe0 msgr2=0x7f5f540b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f52a00640 1 --2- 172.21.15.119:0/3617874063 >> v2:172.21.15.160:3300/0 conn(0x7f5f5409afe0 0x7f5f540b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f52a00640 1 -- 172.21.15.119:0/3617874063 >> v1:172.21.15.119:6789/0 conn(0x7f5f5413f2c0 legacy=0x7f5f5409a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f51600640 1 -- 172.21.15.119:0/3617874063 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424544309 0 0) 0x7f5f5409a080 con 0x7f5f5413f2c0 2024-03-08T21:34:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f52a00640 1 -- 172.21.15.119:0/3617874063 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540b47f0 con 0x7f5f54099ca0 2024-03-08T21:34:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f52a00640 1 --2- 172.21.15.119:0/3617874063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f5413ed80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5f540b4ce0 tx=0x7f5f4401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10808105872b6eab server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f51600640 1 -- 172.21.15.119:0/3617874063 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440b2070 con 0x7f5f54099ca0 2024-03-08T21:34:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f51600640 1 -- 172.21.15.119:0/3617874063 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440a5a10 con 0x7f5f54099ca0 2024-03-08T21:34:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f51600640 1 -- 172.21.15.119:0/3617874063 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440a5de0 con 0x7f5f54099ca0 2024-03-08T21:34:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 -- 172.21.15.119:0/3617874063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 msgr2=0x7f5f5413ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 --2- 172.21.15.119:0/3617874063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f5413ed80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5f540b4ce0 tx=0x7f5f4401c930 comp rx=0 tx=0).stop 2024-03-08T21:34:18.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 -- 172.21.15.119:0/3617874063 shutdown_connections 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 --2- 172.21.15.119:0/3617874063 >> v2:172.21.15.160:3300/0 conn(0x7f5f5409afe0 0x7f5f540b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 --2- 172.21.15.119:0/3617874063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f5413ed80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.729+0000 7f5f59600640 1 -- 172.21.15.119:0/3617874063 >> 172.21.15.119:0/3617874063 conn(0x7f5f5406c620 msgr2=0x7f5f5406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- 172.21.15.119:0/3617874063 shutdown_connections 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- 172.21.15.119:0/3617874063 wait complete. 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 Processor -- start 2024-03-08T21:34:18.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- start start 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 0x7f5f5409cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 0x7f5f5413a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541522d0 con 0x7f5f54099ca0 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54152150 con 0x7f5f5409afe0 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54152450 con 0x7f5f5413f2c0 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50066/0 (socket says 172.21.15.119:50066) 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 -- 172.21.15.119:0/3747212274 learned_addr learned my addr 172.21.15.119:0/3747212274 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52000640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 0x7f5f5409cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 -- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 msgr2=0x7f5f5413a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f53400640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 0x7f5f5413a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 0x7f5f5413a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 -- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 msgr2=0x7f5f5409cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 0x7f5f5409cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 -- 172.21.15.119:0/3747212274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5409c380 con 0x7f5f54099ca0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52000640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 0x7f5f5409cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f53400640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 0x7f5f5413a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f52a00640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f440b0040 tx=0x7f5f440196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440b2050 con 0x7f5f54099ca0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440be070 con 0x7f5f54099ca0 2024-03-08T21:34:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5409c660 con 0x7f5f54099ca0 2024-03-08T21:34:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440adca0 con 0x7f5f54099ca0 2024-03-08T21:34:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.733+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f540b1630 con 0x7f5f54099ca0 2024-03-08T21:34:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54067db0 con 0x7f5f54099ca0 2024-03-08T21:34:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5f440c3460 con 0x7f5f54099ca0 2024-03-08T21:34:18.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f4aa00640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 0x7f5f34069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:18.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f44120d30 con 0x7f5f54099ca0 2024-03-08T21:34:18.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f52000640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 0x7f5f34069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:18.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.737+0000 7f5f52000640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 0x7f5f34069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5f40007fd0 tx=0x7f5f40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:18.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.741+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f5f44016520 con 0x7f5f54099ca0 2024-03-08T21:34:18.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f540b3920 con 0x7f5f54099ca0 2024-03-08T21:34:18.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f4aa00640 1 -- 172.21.15.119:0/3747212274 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f5f440f19a0 con 0x7f5f54099ca0 2024-03-08T21:34:18.885 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:18.885 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 msgr2=0x7f5f34069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 0x7f5f34069b20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5f40007fd0 tx=0x7f5f40009040 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 msgr2=0x7f5f540b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5f440b0040 tx=0x7f5f440196d0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 shutdown_connections 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5f34067660 0x7f5f34069b20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.897+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f5413f2c0 0x7f5f5413a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.901+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f5409afe0 0x7f5f5409cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.901+0000 7f5f59600640 1 --2- 172.21.15.119:0/3747212274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f54099ca0 0x7f5f540b7700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.901+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 >> 172.21.15.119:0/3747212274 conn(0x7f5f5406c620 msgr2=0x7f5f540b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.901+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 shutdown_connections 2024-03-08T21:34:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:18.901+0000 7f5f59600640 1 -- 172.21.15.119:0/3747212274 wait complete. 2024-03-08T21:34:18.906 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T21:34:18.906 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:19.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 Processor -- start 2024-03-08T21:34:19.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 -- start start 2024-03-08T21:34:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1bd806da10 0x7f1bd80b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd806ddf0 con 0x7f1bd8141480 2024-03-08T21:34:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd80b6190 con 0x7f1bd80b6440 2024-03-08T21:34:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bdca00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80b4570 con 0x7f1bd806da10 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd6800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1bd8141480 0x7f1bd8151850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33180/0 (socket says 172.21.15.119:33180) 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd6800640 1 -- 172.21.15.119:0/2490484674 learned_addr learned my addr 172.21.15.119:0/2490484674 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd5e00640 1 --2- 172.21.15.119:0/2490484674 >> v2:172.21.15.160:3300/0 conn(0x7f1bd806da10 0x7f1bd80b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd4a00640 1 -- 172.21.15.119:0/2490484674 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385555948 0 0) 0x7f1bd806ddf0 con 0x7f1bd8141480 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd4a00640 1 -- 172.21.15.119:0/2490484674 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bbc003530 con 0x7f1bd8141480 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd5e00640 1 -- 172.21.15.119:0/2490484674 >> v1:172.21.15.160:6789/0 conn(0x7f1bd80b6440 legacy=0x7f1bd8140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd5e00640 1 -- 172.21.15.119:0/2490484674 >> v1:172.21.15.119:6789/0 conn(0x7f1bd8141480 legacy=0x7f1bd8151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.053+0000 7f1bd5e00640 1 -- 172.21.15.119:0/2490484674 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80b4850 con 0x7f1bd806da10 2024-03-08T21:34:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bd5e00640 1 --2- 172.21.15.119:0/2490484674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd806da10 0x7f1bd80b5560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097c0 tx=0x7f1bc801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d820ff375c28665 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bd4a00640 1 -- 172.21.15.119:0/2490484674 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80b0070 con 0x7f1bd806da10 2024-03-08T21:34:19.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bd4a00640 1 -- 172.21.15.119:0/2490484674 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80ab600 con 0x7f1bd806da10 2024-03-08T21:34:19.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bd4a00640 1 -- 172.21.15.119:0/2490484674 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80ab9d0 con 0x7f1bd806da10 2024-03-08T21:34:19.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- 172.21.15.119:0/2490484674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd806da10 msgr2=0x7f1bd80b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 --2- 172.21.15.119:0/2490484674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd806da10 0x7f1bd80b5560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097c0 tx=0x7f1bc801c410 comp rx=0 tx=0).stop 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- 172.21.15.119:0/2490484674 shutdown_connections 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 --2- 172.21.15.119:0/2490484674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd806da10 0x7f1bd80b5560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- 172.21.15.119:0/2490484674 >> 172.21.15.119:0/2490484674 conn(0x7f1bd806b6e0 msgr2=0x7f1bd80ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- 172.21.15.119:0/2490484674 shutdown_connections 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- 172.21.15.119:0/2490484674 wait complete. 2024-03-08T21:34:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 Processor -- start 2024-03-08T21:34:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.057+0000 7f1bdca00640 1 -- start start 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 0x7f1bd8147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 0x7f1bd812a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd81559a0 con 0x7f1bd806da10 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8155b20 con 0x7f1bd8141480 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8155ca0 con 0x7f1bd80b6440 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50070/0 (socket says 172.21.15.119:50070) 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 -- 172.21.15.119:0/1836004479 learned_addr learned my addr 172.21.15.119:0/1836004479 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd6800640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 0x7f1bd812a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5400640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 0x7f1bd8147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 -- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 msgr2=0x7f1bd8147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 0x7f1bd8147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 -- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 msgr2=0x7f1bd812a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 0x7f1bd812a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 -- 172.21.15.119:0/1836004479 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd81e08a0 con 0x7f1bd806da10 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5400640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 0x7f1bd8147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd6800640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 0x7f1bd812a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bd5e00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ae040 tx=0x7f1bc801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80bb070 con 0x7f1bd806da10 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8004020 con 0x7f1bd806da10 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80b0040 con 0x7f1bd806da10 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd81e0b80 con 0x7f1bd806da10 2024-03-08T21:34:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd81e0350 con 0x7f1bd806da10 2024-03-08T21:34:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd80ba100 con 0x7f1bd806da10 2024-03-08T21:34:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.061+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1bc8003620 con 0x7f1bd806da10 2024-03-08T21:34:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.065+0000 7f1bce000640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 0x7f1bb8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.065+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bc811ffe0 con 0x7f1bd806da10 2024-03-08T21:34:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.065+0000 7f1bd5400640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 0x7f1bb8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.065+0000 7f1bd5400640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 0x7f1bb8069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8136850 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.069+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1bc8016090 con 0x7f1bd806da10 2024-03-08T21:34:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.253+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd8067db0 con 0x7f1bd806da10 2024-03-08T21:34:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.253+0000 7f1bce000640 1 -- 172.21.15.119:0/1836004479 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7f1bc80aa3a0 con 0x7f1bd806da10 2024-03-08T21:34:19.242 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:19.242 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 msgr2=0x7f1bb8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 0x7f1bb8069b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8136850 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 msgr2=0x7f1bd8147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80ae040 tx=0x7f1bc801ac50 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 shutdown_connections 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1bb8067660 0x7f1bb8069b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bd8141480 0x7f1bd812a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bd80b6440 0x7f1bd8147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 --2- 172.21.15.119:0/1836004479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd806da10 0x7f1bd8147320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 >> 172.21.15.119:0/1836004479 conn(0x7f1bd806b6e0 msgr2=0x7f1bd8130c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 shutdown_connections 2024-03-08T21:34:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.257+0000 7f1bdca00640 1 -- 172.21.15.119:0/1836004479 wait complete. 2024-03-08T21:34:19.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 Processor -- start 2024-03-08T21:34:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 -- start start 2024-03-08T21:34:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80dc09a8d0 0x7f80dc09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc09a080 con 0x7f80dc0b1d30 2024-03-08T21:34:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0b4510 con 0x7f80dc099ca0 2024-03-08T21:34:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e4800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0b4b60 con 0x7f80dc09a8d0 2024-03-08T21:34:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e2800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f80dc0b1d30 0x7f80dc0b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33192/0 (socket says 172.21.15.119:33192) 2024-03-08T21:34:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e2800640 1 -- 172.21.15.119:0/2072686653 learned_addr learned my addr 172.21.15.119:0/2072686653 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e1400640 1 --2- 172.21.15.119:0/2072686653 >> v2:172.21.15.160:3300/0 conn(0x7f80dc09a8d0 0x7f80dc09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e0a00640 1 -- 172.21.15.119:0/2072686653 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773792112 0 0) 0x7f80dc09a080 con 0x7f80dc0b1d30 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e0a00640 1 -- 172.21.15.119:0/2072686653 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c4003530 con 0x7f80dc0b1d30 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e1400640 1 -- 172.21.15.119:0/2072686653 >> v1:172.21.15.160:6789/0 conn(0x7f80dc099ca0 legacy=0x7f80dc13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e1400640 1 -- 172.21.15.119:0/2072686653 >> v1:172.21.15.119:6789/0 conn(0x7f80dc0b1d30 legacy=0x7f80dc0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.409+0000 7f80e1400640 1 -- 172.21.15.119:0/2072686653 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0b47f0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e1400640 1 --2- 172.21.15.119:0/2072686653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc09a8d0 0x7f80dc09ad40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0097c0 tx=0x7f80cc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51619130f381653d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e0a00640 1 -- 172.21.15.119:0/2072686653 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0b1070 con 0x7f80dc09a8d0 2024-03-08T21:34:19.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e0a00640 1 -- 172.21.15.119:0/2072686653 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0ac410 con 0x7f80dc09a8d0 2024-03-08T21:34:19.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e0a00640 1 -- 172.21.15.119:0/2072686653 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0ac7e0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 -- 172.21.15.119:0/2072686653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc09a8d0 msgr2=0x7f80dc09ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 --2- 172.21.15.119:0/2072686653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc09a8d0 0x7f80dc09ad40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0097c0 tx=0x7f80cc01c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 -- 172.21.15.119:0/2072686653 shutdown_connections 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 --2- 172.21.15.119:0/2072686653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc09a8d0 0x7f80dc09ad40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 -- 172.21.15.119:0/2072686653 >> 172.21.15.119:0/2072686653 conn(0x7f80dc06c620 msgr2=0x7f80dc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 -- 172.21.15.119:0/2072686653 shutdown_connections 2024-03-08T21:34:19.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.413+0000 7f80e4800640 1 -- 172.21.15.119:0/2072686653 wait complete. 2024-03-08T21:34:19.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 Processor -- start 2024-03-08T21:34:19.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- start start 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 0x7f80dc13f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0b1d30 0x7f80dc13da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1532e0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc153160 con 0x7f80dc099ca0 2024-03-08T21:34:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc153460 con 0x7f80dc0b1d30 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50082/0 (socket says 172.21.15.119:50082) 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 -- 172.21.15.119:0/1585271130 learned_addr learned my addr 172.21.15.119:0/1585271130 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1e00640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 0x7f80dc13f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 -- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0b1d30 msgr2=0x7f80dc13da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e2800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0b1d30 0x7f80dc13da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0b1d30 0x7f80dc13da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 -- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 msgr2=0x7f80dc13f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 0x7f80dc13f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 -- 172.21.15.119:0/1585271130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc140640 con 0x7f80dc09a8d0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1e00640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 0x7f80dc13f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e1400640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0af040 tx=0x7f80cc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0b1040 con 0x7f80dc09a8d0 2024-03-08T21:34:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0ba070 con 0x7f80dc09a8d0 2024-03-08T21:34:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0b5670 con 0x7f80dc09a8d0 2024-03-08T21:34:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc1e16a0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.417+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc1408b0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc067db0 con 0x7f80dc09a8d0 2024-03-08T21:34:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f80cc0b5810 con 0x7f80dc09a8d0 2024-03-08T21:34:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80d6000640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 0x7f80c0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80cc11f510 con 0x7f80dc09a8d0 2024-03-08T21:34:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80e1e00640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 0x7f80c0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.421+0000 7f80e1e00640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 0x7f80c0069b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80d0001650 tx=0x7f80d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.425+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f80cc016090 con 0x7f80dc09a8d0 2024-03-08T21:34:19.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80dc142820 con 0x7f80dc09a8d0 2024-03-08T21:34:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80d6000640 1 -- 172.21.15.119:0/1585271130 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3358 (secure 0 0 0) 0x7f80cc0f0180 con 0x7f80dc09a8d0 2024-03-08T21:34:19.604 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:19.604 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/4040733124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4040733124},{"type":"v1","addr":"172.21.15.160:6833","nonce":4040733124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:33:48.672392+0000","modified":"2024-03-08T21:33:51.698510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/2659497367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2659497367},{"type":"v1","addr":"172.21.15.119:6835","nonce":2659497367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T21:34:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 8 2024-03-08T21:34:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 msgr2=0x7f80c0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 0x7f80c0069b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80d0001650 tx=0x7f80d0009040 comp rx=0 tx=0).stop 2024-03-08T21:34:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 msgr2=0x7f80dc1e0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0af040 tx=0x7f80cc019240 comp rx=0 tx=0).stop 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 shutdown_connections 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f80c0067660 0x7f80c0069b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80dc0b1d30 0x7f80dc13da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80dc09a8d0 0x7f80dc1e0ca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 --2- 172.21.15.119:0/1585271130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80dc099ca0 0x7f80dc13f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 >> 172.21.15.119:0/1585271130 conn(0x7f80dc06c620 msgr2=0x7f80dc06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 shutdown_connections 2024-03-08T21:34:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.617+0000 7f80e4800640 1 -- 172.21.15.119:0/1585271130 wait complete. 2024-03-08T21:34:19.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:19.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 Processor -- start 2024-03-08T21:34:19.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 -- start start 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b4410 0x7f037c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f037c0b47f0 0x7f037c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0b2be0 con 0x7f037c13eba0 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c0b5970 con 0x7f037c0b47f0 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f0381800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0b5fb0 con 0x7f037c0b4410 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037a000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f037c0b47f0 0x7f037c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037b400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f037c13eba0 0x7f037c148320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33202/0 (socket says 172.21.15.119:33202) 2024-03-08T21:34:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037b400640 1 -- 172.21.15.119:0/4069297717 learned_addr learned my addr 172.21.15.119:0/4069297717 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037aa00640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b4410 0x7f037c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037a000640 1 -- 172.21.15.119:0/4069297717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b4410 msgr2=0x7f037c0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037a000640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b4410 0x7f037c0b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037a000640 1 -- 172.21.15.119:0/4069297717 >> v1:172.21.15.119:6789/0 conn(0x7f037c13eba0 legacy=0x7f037c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.773+0000 7f037a000640 1 -- 172.21.15.119:0/4069297717 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0b5600 con 0x7f037c0b47f0 2024-03-08T21:34:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f037a000640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c0b47f0 0x7f037c0b3820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f03680097c0 tx=0x7f036801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6ee72a185a0104 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0379600640 1 -- 172.21.15.119:0/4069297717 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680b0070 con 0x7f037c0b47f0 2024-03-08T21:34:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0379600640 1 -- 172.21.15.119:0/4069297717 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03680ab600 con 0x7f037c0b47f0 2024-03-08T21:34:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0379600640 1 -- 172.21.15.119:0/4069297717 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680ab9d0 con 0x7f037c0b47f0 2024-03-08T21:34:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- 172.21.15.119:0/4069297717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c0b47f0 msgr2=0x7f037c0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c0b47f0 0x7f037c0b3820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f03680097c0 tx=0x7f036801c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- 172.21.15.119:0/4069297717 shutdown_connections 2024-03-08T21:34:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c0b47f0 0x7f037c0b3820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 --2- 172.21.15.119:0/4069297717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b4410 0x7f037c0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- 172.21.15.119:0/4069297717 >> 172.21.15.119:0/4069297717 conn(0x7f037c06b6e0 msgr2=0x7f037c0ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- 172.21.15.119:0/4069297717 shutdown_connections 2024-03-08T21:34:19.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- 172.21.15.119:0/4069297717 wait complete. 2024-03-08T21:34:19.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 Processor -- start 2024-03-08T21:34:19.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.777+0000 7f0381800640 1 -- start start 2024-03-08T21:34:19.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f037c0b4410 0x7f037c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 0x7f037c13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c152670 con 0x7f037c13eba0 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c1527f0 con 0x7f037c0b4410 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c152970 con 0x7f037c0b47f0 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50092/0 (socket says 172.21.15.119:50092) 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 -- 172.21.15.119:0/1012781183 learned_addr learned my addr 172.21.15.119:0/1012781183 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037aa00640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f037c0b4410 0x7f037c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037a000640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 0x7f037c13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 -- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 msgr2=0x7f037c13f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 0x7f037c13f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 -- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f037c0b4410 msgr2=0x7f037c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f037c0b4410 0x7f037c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 -- 172.21.15.119:0/1012781183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0ba600 con 0x7f037c13eba0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037a000640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 0x7f037c13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f037b400640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f037400cbc0 tx=0x7f037400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374017070 con 0x7f037c13eba0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400ad40 con 0x7f037c13eba0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374012600 con 0x7f037c13eba0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c1400c0 con 0x7f037c13eba0 2024-03-08T21:34:19.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c1459a0 con 0x7f037c13eba0 2024-03-08T21:34:19.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c067db0 con 0x7f037c13eba0 2024-03-08T21:34:19.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.781+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f037401a070 con 0x7f037c13eba0 2024-03-08T21:34:19.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.785+0000 7f0372a00640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 0x7f035c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:19.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.785+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0374085500 con 0x7f037c13eba0 2024-03-08T21:34:19.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.785+0000 7f037aa00640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 0x7f035c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:19.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.785+0000 7f037aa00640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 0x7f035c069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f036c0079c0 tx=0x7f036c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:19.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.789+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f0374055b20 con 0x7f037c13eba0 2024-03-08T21:34:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.941+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037c13e630 con 0x7f037c13eba0 2024-03-08T21:34:19.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0372a00640 1 -- 172.21.15.119:0/1012781183 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f0374059bc0 con 0x7f037c13eba0 2024-03-08T21:34:19.932 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:19.932 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":21,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:33:50.319618+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:33:46.391731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T21:33:47.679209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 msgr2=0x7f035c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 0x7f035c069b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f036c0079c0 tx=0x7f036c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 msgr2=0x7f037c1448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f037400cbc0 tx=0x7f037400a430 comp rx=0 tx=0).stop 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 shutdown_connections 2024-03-08T21:34:19.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f035c067660 0x7f035c069b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f037c13eba0 0x7f037c1448c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f037c0b47f0 0x7f037c13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 --2- 172.21.15.119:0/1012781183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f037c0b4410 0x7f037c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 >> 172.21.15.119:0/1012781183 conn(0x7f037c06b6e0 msgr2=0x7f037c13dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 shutdown_connections 2024-03-08T21:34:19.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:19.945+0000 7f0381800640 1 -- 172.21.15.119:0/1012781183 wait complete. 2024-03-08T21:34:19.953 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-08T21:34:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 Processor -- start 2024-03-08T21:34:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 -- start start 2024-03-08T21:34:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f308009ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308009a080 con 0x7f30800b1d30 2024-03-08T21:34:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30800b4510 con 0x7f3080099ca0 2024-03-08T21:34:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3088800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800b4b60 con 0x7f308009a8d0 2024-03-08T21:34:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3086800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f30800b1d30 0x7f30800b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33216/0 (socket says 172.21.15.119:33216) 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3086800640 1 -- 172.21.15.119:0/1104285893 learned_addr learned my addr 172.21.15.119:0/1104285893 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3085400640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f308009ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889484256 0 0) 0x7f308009a080 con 0x7f30800b1d30 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3068003530 con 0x7f30800b1d30 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293805801 0 0) 0x7f30800b4510 con 0x7f3080099ca0 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308009a080 con 0x7f3080099ca0 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052829145 0 0) 0x7f3068003530 con 0x7f30800b1d30 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 msgr2=0x7f308009ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f308009ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 >> v1:172.21.15.160:6789/0 conn(0x7f3080099ca0 legacy=0x7f308013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.101+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800b47f0 con 0x7f30800b1d30 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f307c001a00 con 0x7f30800b1d30 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 >> v1:172.21.15.119:6789/0 conn(0x7f30800b1d30 legacy=0x7f30800b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f3068003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30680040e0 0x7f3068004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068004d50 0x7f30680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800b4b60 con 0x7f30680040e0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306800bab0 con 0x7f3068004d50 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306800bcb0 con 0x7f308009a8d0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30680040e0 0x7f3068004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3086800640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068004d50 0x7f30680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085e00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f3068003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 -- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 msgr2=0x7f3068003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f3068003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 -- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068004d50 msgr2=0x7f30680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3068004d50 0x7f30680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 -- 172.21.15.119:0/1104285893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068003530 con 0x7f30680040e0 2024-03-08T21:34:20.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085e00640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f308009a8d0 0x7f3068003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3085400640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30680040e0 0x7f3068004810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ae0 tx=0x7f307001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82384cac73847ed5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700b2070 con 0x7f30680040e0 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30700a5660 con 0x7f30680040e0 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.105+0000 7f3084a00640 1 -- 172.21.15.119:0/1104285893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700096b0 con 0x7f30680040e0 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- 172.21.15.119:0/1104285893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30680040e0 msgr2=0x7f3068004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 --2- 172.21.15.119:0/1104285893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30680040e0 0x7f3068004810 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ae0 tx=0x7f307001ca70 comp rx=0 tx=0).stop 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3086800640 1 -- 172.21.15.119:0/1104285893 reap_dead start 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- 172.21.15.119:0/1104285893 shutdown_connections 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- 172.21.15.119:0/1104285893 >> 172.21.15.119:0/1104285893 conn(0x7f308006c620 msgr2=0x7f308006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- 172.21.15.119:0/1104285893 shutdown_connections 2024-03-08T21:34:20.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- 172.21.15.119:0/1104285893 wait complete. 2024-03-08T21:34:20.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 Processor -- start 2024-03-08T21:34:20.097 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- start start 2024-03-08T21:34:20.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 0x7f308013a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30801ddfb0 0x7f30801de440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308009ae90 con 0x7f30800702c0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308009ad10 con 0x7f30680040e0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3088800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308009b010 con 0x7f30801ddfb0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50106/0 (socket says 172.21.15.119:50106) 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 -- 172.21.15.119:0/3000508139 learned_addr learned my addr 172.21.15.119:0/3000508139 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085e00640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 0x7f308013a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3086800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30801ddfb0 0x7f30801de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 -- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30801ddfb0 msgr2=0x7f30801de440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30801ddfb0 0x7f30801de440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 -- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 msgr2=0x7f308013a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 0x7f308013a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 -- 172.21.15.119:0/3000508139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800713a0 con 0x7f30800702c0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085e00640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 0x7f308013a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.109+0000 7f3085400640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ae0 tx=0x7f3068005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700bc030 con 0x7f30800702c0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307000f000 con 0x7f30800702c0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700b2040 con 0x7f30800702c0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3080071610 con 0x7f30800702c0 2024-03-08T21:34:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308006fda0 con 0x7f30800702c0 2024-03-08T21:34:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080067db0 con 0x7f30800702c0 2024-03-08T21:34:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f30700bf070 con 0x7f30800702c0 2024-03-08T21:34:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 0x7f3064069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f307011f300 con 0x7f30800702c0 2024-03-08T21:34:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.113+0000 7f3085e00640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 0x7f3064069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.117+0000 7f3085e00640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 0x7f3064069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f308013aae0 tx=0x7f3074009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.117+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f3070016780 con 0x7f30800702c0 2024-03-08T21:34:20.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.309+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3080070020 con 0x7f30800702c0 2024-03-08T21:34:20.297 INFO:tasks.ceph.mon.a.smithi119.stderr:2024-03-08T21:34:20.309+0000 7fad3cc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-08T21:34:20.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.313+0000 7f307a000640 1 -- 172.21.15.119:0/3000508139 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f30700ef920 con 0x7f30800702c0 2024-03-08T21:34:20.299 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-08T21:34:20.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.313+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 msgr2=0x7f3064069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.303 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.313+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 0x7f3064069b20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f308013aae0 tx=0x7f3074009040 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.313+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 msgr2=0x7f308006f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.313+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ae0 tx=0x7f3068005840 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 shutdown_connections 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3064067660 0x7f3064069b20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30801ddfb0 0x7f30801de440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30800702c0 0x7f308006f860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 --2- 172.21.15.119:0/3000508139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30680040e0 0x7f308013a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 >> 172.21.15.119:0/3000508139 conn(0x7f308006c620 msgr2=0x7f308013be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 shutdown_connections 2024-03-08T21:34:20.304 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.317+0000 7f3088800640 1 -- 172.21.15.119:0/3000508139 wait complete. 2024-03-08T21:34:20.307 INFO:tasks.ceph.mds.a.smithi119.stderr: -1157> 2024-03-08T21:33:52.755+0000 7f781ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T21:34:20.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-08T21:34:20.350 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-03-08T21:34:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 Processor -- start 2024-03-08T21:34:20.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 -- start start 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3f806c840 0x7fd3f80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3f81413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f806cc20 con 0x7fd3f8144030 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80b3670 con 0x7fd3f806c840 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3fd000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80b3950 con 0x7fd3f8140fb0 2024-03-08T21:34:20.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f5400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd3f8144030 0x7fd3f81444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33232/0 (socket says 172.21.15.119:33232) 2024-03-08T21:34:20.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f5400640 1 -- 172.21.15.119:0/3469476243 learned_addr learned my addr 172.21.15.119:0/3469476243 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:20.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3f81413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f5e00640 1 --2- 172.21.15.119:0/3469476243 >> v2:172.21.15.160:3300/0 conn(0x7fd3f806c840 0x7fd3f80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281664524 0 0) 0x7fd3f806cc20 con 0x7fd3f8144030 2024-03-08T21:34:20.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc005740 con 0x7fd3f8144030 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134665849 0 0) 0x7fd3dc005740 con 0x7fd3f8144030 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 msgr2=0x7fd3f81413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3f81413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 >> v2:172.21.15.160:3300/0 conn(0x7fd3f806c840 msgr2=0x7fd3f80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 --2- 172.21.15.119:0/3469476243 >> v2:172.21.15.160:3300/0 conn(0x7fd3f806c840 0x7fd3f80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8141920 con 0x7fd3f8144030 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fd3e4001680 con 0x7fd3f8144030 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 >> v1:172.21.15.119:6789/0 conn(0x7fd3f8144030 legacy=0x7fd3f81444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3dc005bd0 0x7fd3dc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3dc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3dc006f60 0x7fd3dc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80b3670 con 0x7fd3dc006f60 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80b3950 con 0x7fd3dc005bd0 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00dbe0 con 0x7fd3f8140fb0 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3dc006f60 0x7fd3dc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f5e00640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3dc005bd0 0x7fd3dc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f5400640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3dc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 -- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 msgr2=0x7fd3dc006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3f8140fb0 0x7fd3dc006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 -- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3dc005bd0 msgr2=0x7fd3dc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3dc005bd0 0x7fd3dc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.477+0000 7fd3f6800640 1 -- 172.21.15.119:0/3469476243 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc005740 con 0x7fd3dc006f60 2024-03-08T21:34:20.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3f6800640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3dc006f60 0x7fd3dc0073e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009fc0 tx=0x7fd3f001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664a2107805613d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00b0070 con 0x7fd3dc006f60 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00ab600 con 0x7fd3dc006f60 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3f4a00640 1 -- 172.21.15.119:0/3469476243 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0009c10 con 0x7fd3dc006f60 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 -- 172.21.15.119:0/3469476243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3dc006f60 msgr2=0x7fd3dc0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 --2- 172.21.15.119:0/3469476243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3dc006f60 0x7fd3dc0073e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009fc0 tx=0x7fd3f001c960 comp rx=0 tx=0).stop 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3f6800640 1 -- 172.21.15.119:0/3469476243 reap_dead start 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 -- 172.21.15.119:0/3469476243 shutdown_connections 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 -- 172.21.15.119:0/3469476243 >> 172.21.15.119:0/3469476243 conn(0x7fd3f809a230 msgr2=0x7fd3f809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 -- 172.21.15.119:0/3469476243 shutdown_connections 2024-03-08T21:34:20.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.481+0000 7fd3fd000640 1 -- 172.21.15.119:0/3469476243 wait complete. 2024-03-08T21:34:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 Processor -- start 2024-03-08T21:34:20.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- start start 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3dc006f60 0x7fd3f81d2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3f81ca400 0x7fd3f81ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806d610 con 0x7fd3f813f800 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806d490 con 0x7fd3f81ca400 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806d790 con 0x7fd3dc006f60 2024-03-08T21:34:20.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50138/0 (socket says 172.21.15.119:50138) 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 -- 172.21.15.119:0/371970858 learned_addr learned my addr 172.21.15.119:0/371970858 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5e00640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3dc006f60 0x7fd3f81d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f6800640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3f81ca400 0x7fd3f81ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 -- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3dc006f60 msgr2=0x7fd3f81d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3dc006f60 0x7fd3f81d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 -- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3f81ca400 msgr2=0x7fd3f81ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3f81ca400 0x7fd3f81ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 -- 172.21.15.119:0/371970858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f813fc60 con 0x7fd3f813f800 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3f5400640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4012520 tx=0x7fd3e4012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401c070 con 0x7fd3f813f800 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4014850 con 0x7fd3f813f800 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f81c9e40 con 0x7fd3f813f800 2024-03-08T21:34:20.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4014c40 con 0x7fd3f813f800 2024-03-08T21:34:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f81ca0e0 con 0x7fd3f813f800 2024-03-08T21:34:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.485+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f8067db0 con 0x7fd3f813f800 2024-03-08T21:34:20.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.489+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd3e401f070 con 0x7fd3f813f800 2024-03-08T21:34:20.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.489+0000 7fd3ee000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 0x7fd3d8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:20.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.489+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd3e4088440 con 0x7fd3f813f800 2024-03-08T21:34:20.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.489+0000 7fd3f5e00640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 0x7fd3d8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:20.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.489+0000 7fd3f5e00640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 0x7fd3d8069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009be0 tx=0x7fd3e8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:20.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.493+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd3e40590f0 con 0x7fd3f813f800 2024-03-08T21:34:20.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:20.685+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd3f80b8260 con 0x7fd3f813f800 2024-03-08T21:34:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.317+0000 7fd3ee000640 1 -- 172.21.15.119:0/371970858 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd3e40589f0 con 0x7fd3f813f800 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.317+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 msgr2=0x7fd3d8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.317+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 0x7fd3d8069b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009be0 tx=0x7fd3e8009190 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 msgr2=0x7fd3f81cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4012520 tx=0x7fd3e4012920 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 shutdown_connections 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3d8067660 0x7fd3d8069b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3f81ca400 0x7fd3f81ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3f813f800 0x7fd3f81cb660 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 --2- 172.21.15.119:0/371970858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3dc006f60 0x7fd3f81d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 >> 172.21.15.119:0/371970858 conn(0x7fd3f809a230 msgr2=0x7fd3f81404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 shutdown_connections 2024-03-08T21:34:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.321+0000 7fd3fd000640 1 -- 172.21.15.119:0/371970858 wait complete. 2024-03-08T21:34:21.331 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-08T21:34:21.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 Processor -- start 2024-03-08T21:34:21.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 -- start start 2024-03-08T21:34:21.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f097c0b4420 0x7f097c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c06d5f0 con 0x7f097c0b74c0 2024-03-08T21:34:21.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c0b39c0 con 0x7f097c0b4420 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0980a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0b3ca0 con 0x7f097c14ecb0 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f097c0b4420 0x7f097c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f097c0b4420 0x7f097c0b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50146/0 (socket says 172.21.15.119:50146) 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 -- 172.21.15.119:0/2625663938 learned_addr learned my addr 172.21.15.119:0/2625663938 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979400640 1 --1- 172.21.15.119:0/2625663938 >> v1:172.21.15.119:6789/0 conn(0x7f097c0b74c0 0x7f097c0b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:33236/0 (socket says 172.21.15.119:33236) 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f097a800640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 -- 172.21.15.119:0/2625663938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 msgr2=0x7f097c1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 -- 172.21.15.119:0/2625663938 >> v1:172.21.15.119:6789/0 conn(0x7f097c0b74c0 legacy=0x7f097c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0979e00640 1 -- 172.21.15.119:0/2625663938 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c06d890 con 0x7f097c0b4420 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f0978a00640 1 -- 172.21.15.119:0/2625663938 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589685415 0 0) 0x7f097c06d5f0 con 0x7f097c0b74c0 2024-03-08T21:34:21.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.529+0000 7f097a800640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:21.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0979e00640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c0b4800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f096c009870 tx=0x7f096c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef86908e18e23ae0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:21.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0978a00640 1 -- 172.21.15.119:0/2625663938 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0b1070 con 0x7f097c0b4420 2024-03-08T21:34:21.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0978a00640 1 -- 172.21.15.119:0/2625663938 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c0a8050 con 0x7f097c0b4420 2024-03-08T21:34:21.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0978a00640 1 -- 172.21.15.119:0/2625663938 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0ac860 con 0x7f097c0b4420 2024-03-08T21:34:21.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- 172.21.15.119:0/2625663938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 msgr2=0x7f097c0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c0b4800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f096c009870 tx=0x7f096c01c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- 172.21.15.119:0/2625663938 shutdown_connections 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 --2- 172.21.15.119:0/2625663938 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c0b4800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- 172.21.15.119:0/2625663938 >> 172.21.15.119:0/2625663938 conn(0x7f097c09a230 msgr2=0x7f097c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- 172.21.15.119:0/2625663938 shutdown_connections 2024-03-08T21:34:21.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- 172.21.15.119:0/2625663938 wait complete. 2024-03-08T21:34:21.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 Processor -- start 2024-03-08T21:34:21.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.533+0000 7f0980a00640 1 -- start start 2024-03-08T21:34:21.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f097c0b74c0 0x7f097c06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154190 con 0x7f097c0b4420 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154010 con 0x7f097c0b74c0 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154310 con 0x7f097c14ecb0 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50148/0 (socket says 172.21.15.119:50148) 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 -- 172.21.15.119:0/2727079261 learned_addr learned my addr 172.21.15.119:0/2727079261 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 -- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 msgr2=0x7f097c06fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 -- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f097c0b74c0 msgr2=0x7f097c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f097c0b74c0 0x7f097c06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:21.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 -- 172.21.15.119:0/2727079261 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0ad4a0 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0979e00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f096c01ab80 tx=0x7f096c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0bb070 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c004220 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c0af3d0 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0b1040 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c071120 con 0x7f097c0b4420 2024-03-08T21:34:21.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c0ae650 con 0x7f097c0b4420 2024-03-08T21:34:21.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.537+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f096c003620 con 0x7f097c0b4420 2024-03-08T21:34:21.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.541+0000 7f0972000640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 0x7f095c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:21.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.541+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f096c11fcc0 con 0x7f097c0b4420 2024-03-08T21:34:21.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.541+0000 7f0979400640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 0x7f095c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:21.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.541+0000 7f0979400640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 0x7f095c069b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09680011f0 tx=0x7f0968007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:21.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.541+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f096c126080 con 0x7f097c0b4420 2024-03-08T21:34:21.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:21.701+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f097c14f230 con 0x7f097c0b4420 2024-03-08T21:34:22.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.461+0000 7f0972000640 1 -- 172.21.15.119:0/2727079261 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f096c016150 con 0x7f097c0b4420 2024-03-08T21:34:22.451 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2024-03-08T21:34:22.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 msgr2=0x7f095c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 0x7f095c069b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09680011f0 tx=0x7f0968007930 comp rx=0 tx=0).stop 2024-03-08T21:34:22.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 msgr2=0x7f097c071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f096c01ab80 tx=0x7f096c01ad10 comp rx=0 tx=0).stop 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 shutdown_connections 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f095c067690 0x7f095c069b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f097c14ecb0 0x7f097c06fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f097c0b74c0 0x7f097c06f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 --2- 172.21.15.119:0/2727079261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0b4420 0x7f097c071f40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 >> 172.21.15.119:0/2727079261 conn(0x7f097c09a230 msgr2=0x7f097c06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:22.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 shutdown_connections 2024-03-08T21:34:22.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.469+0000 7f0980a00640 1 -- 172.21.15.119:0/2727079261 wait complete. 2024-03-08T21:34:22.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-08T21:34:22.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 Processor -- start 2024-03-08T21:34:22.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 -- start start 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa908142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9080b4690 0x7fa90814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90806e0b0 con 0x7fa9080b42b0 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9081456a0 con 0x7fa9080b4690 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90fe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080b3850 con 0x7fa908145b30 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9080b4690 0x7fa90814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9080b4690 0x7fa90814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43220/0 (socket says 172.21.15.119:43220) 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 -- 172.21.15.119:0/3749210862 learned_addr learned my addr 172.21.15.119:0/3749210862 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90ca00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa908142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 -- 172.21.15.119:0/3749210862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 msgr2=0x7fa908142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa908142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 -- 172.21.15.119:0/3749210862 >> v1:172.21.15.160:6789/0 conn(0x7fa9080b42b0 legacy=0x7fa90806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.637+0000 7fa90de00640 1 -- 172.21.15.119:0/3749210862 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908145050 con 0x7fa9080b4690 2024-03-08T21:34:22.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90de00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b4690 0x7fa90814f6e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e50 tx=0x7fa90001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07576ef1dd476df server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa907e00640 1 -- 172.21.15.119:0/3749210862 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000a5770 con 0x7fa9080b4690 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa907e00640 1 -- 172.21.15.119:0/3749210862 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000a5910 con 0x7fa9080b4690 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa907e00640 1 -- 172.21.15.119:0/3749210862 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000a5ce0 con 0x7fa9080b4690 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 -- 172.21.15.119:0/3749210862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b4690 msgr2=0x7fa90814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b4690 0x7fa90814f6e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa900009e50 tx=0x7fa90001c9a0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 -- 172.21.15.119:0/3749210862 shutdown_connections 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b4690 0x7fa90814f6e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 --2- 172.21.15.119:0/3749210862 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa908142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 -- 172.21.15.119:0/3749210862 >> 172.21.15.119:0/3749210862 conn(0x7fa90809a230 msgr2=0x7fa90809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:22.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 -- 172.21.15.119:0/3749210862 shutdown_connections 2024-03-08T21:34:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.641+0000 7fa90fe00640 1 -- 172.21.15.119:0/3749210862 wait complete. 2024-03-08T21:34:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 Processor -- start 2024-03-08T21:34:22.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- start start 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9080b4690 0x7fa908070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa90813cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081527d0 con 0x7fa9080b42b0 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa908152650 con 0x7fa9080b4690 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908152950 con 0x7fa908145b30 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43226/0 (socket says 172.21.15.119:43226) 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 -- 172.21.15.119:0/149016056 learned_addr learned my addr 172.21.15.119:0/149016056 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:22.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90ca00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9080b4690 0x7fa908070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90de00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa90813cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 -- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 msgr2=0x7fa90813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa90813cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 -- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9080b4690 msgr2=0x7fa908070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9080b4690 0x7fa908070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 -- 172.21.15.119:0/149016056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080b0220 con 0x7fa9080b42b0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90d400640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c3a0 tx=0x7fa8fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0052d0 con 0x7fa9080b42b0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005470 con 0x7fa9080b42b0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9080b04c0 con 0x7fa9080b42b0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc007260 con 0x7fa9080b42b0 2024-03-08T21:34:22.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.645+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080b2240 con 0x7fa9080b42b0 2024-03-08T21:34:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa908067db0 con 0x7fa9080b42b0 2024-03-08T21:34:22.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa8fc007400 con 0x7fa9080b42b0 2024-03-08T21:34:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa905600640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 0x7fa8e8069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fa8fc084b40 con 0x7fa9080b42b0 2024-03-08T21:34:22.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa90ca00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 0x7fa8e8069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:22.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.649+0000 7fa90ca00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 0x7fa8e8069b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa908143f60 tx=0x7fa8f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:22.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.653+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa8fc0552c0 con 0x7fa9080b42b0 2024-03-08T21:34:22.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:22.809+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa90809da10 con 0x7fa9080b42b0 2024-03-08T21:34:23.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.465+0000 7fa905600640 1 -- 172.21.15.119:0/149016056 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa8fc059360 con 0x7fa9080b42b0 2024-03-08T21:34:23.453 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2024-03-08T21:34:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.465+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 msgr2=0x7fa8e8069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.465+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 0x7fa8e8069b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa908143f60 tx=0x7fa8f4008040 comp rx=0 tx=0).stop 2024-03-08T21:34:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.465+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 msgr2=0x7fa9080afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.465+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c3a0 tx=0x7fa8fc00c860 comp rx=0 tx=0).stop 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 shutdown_connections 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa8e8067690 0x7fa8e8069b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa908145b30 0x7fa90813cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9080b4690 0x7fa908070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 --2- 172.21.15.119:0/149016056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9080b42b0 0x7fa9080afa80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 >> 172.21.15.119:0/149016056 conn(0x7fa90809a230 msgr2=0x7fa908142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 shutdown_connections 2024-03-08T21:34:23.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.469+0000 7fa90fe00640 1 -- 172.21.15.119:0/149016056 wait complete. 2024-03-08T21:34:23.481 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-08T21:34:23.482 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-08T21:34:23.482 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-08T21:34:23.482 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:34:23.482 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-08T21:34:23.482 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-08T21:34:23.482 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-08T21:34:23.483 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:34:23.494 INFO:tasks.ceph.mds.a:Stopped 2024-03-08T21:34:23.494 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-08T21:34:23.495 INFO:tasks.ceph.mds.b:Stopped 2024-03-08T21:34:23.495 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-08T21:34:23.537 INFO:tasks.ceph.mds.a:Started 2024-03-08T21:34:23.538 DEBUG:teuthology.parallel:result is None 2024-03-08T21:34:23.538 INFO:tasks.ceph.mds.b:Started 2024-03-08T21:34:23.539 DEBUG:teuthology.parallel:result is None 2024-03-08T21:34:23.539 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-08T21:34:23.621 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-03-08T21:34:23.627 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-03-08T21:34:23.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 Processor -- start 2024-03-08T21:34:23.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 -- start start 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe2d8072fe0 0x7fe2d809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d81448b0 0x7fe2d813d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d809b190 con 0x7fe2d809adb0 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d809d240 con 0x7fe2d8072fe0 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2dde00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d809d520 con 0x7fe2d81448b0 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe2d8072fe0 0x7fe2d809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe2d809adb0 0x7fe2d81441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54264/0 (socket says 172.21.15.119:54264) 2024-03-08T21:34:23.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6a00640 1 -- 172.21.15.119:0/2871746780 learned_addr learned my addr 172.21.15.119:0/2871746780 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d7400640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d81448b0 0x7fe2d813d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6000640 1 -- 172.21.15.119:0/2871746780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d81448b0 msgr2=0x7fe2d813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6000640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d81448b0 0x7fe2d813d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d5600640 1 -- 172.21.15.119:0/2871746780 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184636913 0 0) 0x7fe2d809b190 con 0x7fe2d809adb0 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6000640 1 -- 172.21.15.119:0/2871746780 >> v1:172.21.15.119:6789/0 conn(0x7fe2d809adb0 legacy=0x7fe2d81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.689+0000 7fe2d6000640 1 -- 172.21.15.119:0/2871746780 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8143c50 con 0x7fe2d8072fe0 2024-03-08T21:34:23.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2d6000640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d8072fe0 0x7fe2d809cbf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40097c0 tx=0x7fe2c401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a03c85e34a20c38 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:23.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2d5600640 1 -- 172.21.15.119:0/2871746780 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40ab660 con 0x7fe2d8072fe0 2024-03-08T21:34:23.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2d5600640 1 -- 172.21.15.119:0/2871746780 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c40b0070 con 0x7fe2d8072fe0 2024-03-08T21:34:23.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2d5600640 1 -- 172.21.15.119:0/2871746780 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40aba20 con 0x7fe2d8072fe0 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 -- 172.21.15.119:0/2871746780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d8072fe0 msgr2=0x7fe2d809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d8072fe0 0x7fe2d809cbf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40097c0 tx=0x7fe2c401c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 -- 172.21.15.119:0/2871746780 shutdown_connections 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d81448b0 0x7fe2d813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 --2- 172.21.15.119:0/2871746780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d8072fe0 0x7fe2d809cbf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 -- 172.21.15.119:0/2871746780 >> 172.21.15.119:0/2871746780 conn(0x7fe2d806c620 msgr2=0x7fe2d806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:23.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 -- 172.21.15.119:0/2871746780 shutdown_connections 2024-03-08T21:34:23.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.693+0000 7fe2dde00640 1 -- 172.21.15.119:0/2871746780 wait complete. 2024-03-08T21:34:23.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 Processor -- start 2024-03-08T21:34:23.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- start start 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d8072fe0 0x7fe2d8137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d809adb0 0x7fe2d81dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8151180 con 0x7fe2d81448b0 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8151000 con 0x7fe2d8072fe0 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8151300 con 0x7fe2d809adb0 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43260/0 (socket says 172.21.15.119:43260) 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 -- 172.21.15.119:0/973322405 learned_addr learned my addr 172.21.15.119:0/973322405 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 -- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d809adb0 msgr2=0x7fe2d81dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d809adb0 0x7fe2d81dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 -- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d8072fe0 msgr2=0x7fe2d8137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:23.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d8072fe0 0x7fe2d8137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 -- 172.21.15.119:0/973322405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80b7380 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2d7400640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e960 tx=0x7fe2d000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0017070 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000c9a0 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80b8120 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000cd70 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.697+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80b7620 con 0x7fe2d81448b0 2024-03-08T21:34:23.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d8067db0 con 0x7fe2d81448b0 2024-03-08T21:34:23.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe2d001a070 con 0x7fe2d81448b0 2024-03-08T21:34:23.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2cf400640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 0x7fe2b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:23.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2d0085570 con 0x7fe2d81448b0 2024-03-08T21:34:23.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2d6a00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 0x7fe2b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:23.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.701+0000 7fe2d6a00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 0x7fe2b8069b20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001570 tx=0x7fe2c8007cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:23.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.705+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fe2d00564e0 con 0x7fe2d81448b0 2024-03-08T21:34:23.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:23.873+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe2d80b3580 con 0x7fe2d81448b0 2024-03-08T21:34:24.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.485+0000 7fe2cf400640 1 -- 172.21.15.119:0/973322405 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2d0055de0 con 0x7fe2d81448b0 2024-03-08T21:34:24.475 INFO:teuthology.orchestra.run.smithi119.stderr: removed all blocklist entries 2024-03-08T21:34:24.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 msgr2=0x7fe2b8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 0x7fe2b8069b20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001570 tx=0x7fe2c8007cb0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 msgr2=0x7fe2d81e0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000e960 tx=0x7fe2d000ee20 comp rx=0 tx=0).stop 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 shutdown_connections 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe2b8067660 0x7fe2b8069b20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2d81448b0 0x7fe2d81e0120 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2d809adb0 0x7fe2d81dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 --2- 172.21.15.119:0/973322405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2d8072fe0 0x7fe2d8137740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 >> 172.21.15.119:0/973322405 conn(0x7fe2d806c620 msgr2=0x7fe2d809a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 shutdown_connections 2024-03-08T21:34:24.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.489+0000 7fe2dde00640 1 -- 172.21.15.119:0/973322405 wait complete. 2024-03-08T21:34:24.498 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-08T21:34:24.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 Processor -- start 2024-03-08T21:34:24.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 -- start start 2024-03-08T21:34:24.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 0x7f403413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f403413f2c0 0x7f403409a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40340b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403409b240 con 0x7f403413f2c0 2024-03-08T21:34:24.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40340b4b60 con 0x7f4034099ca0 2024-03-08T21:34:24.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403409a080 con 0x7f403409ae10 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403a200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40340b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f403413f2c0 0x7f403409a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4039800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 0x7f403413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403a200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40340b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:48804/0 (socket says 172.21.15.119:48804) 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4039800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 0x7f403413ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:51326/0 (socket says 172.21.15.119:51326) 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f403a200640 1 -- 172.21.15.119:0/1665024611 learned_addr learned my addr 172.21.15.119:0/1665024611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 -- 172.21.15.119:0/1665024611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 msgr2=0x7f40340b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 --2- 172.21.15.119:0/1665024611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40340b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 -- 172.21.15.119:0/1665024611 >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 msgr2=0x7f403413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 --2- 172.21.15.119:0/1665024611 >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 0x7f403413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.653+0000 7f4038e00640 1 -- 172.21.15.119:0/1665024611 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340b4510 con 0x7f403413f2c0 2024-03-08T21:34:24.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f4038e00640 1 --2- 172.21.15.119:0/1665024611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f403409a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f403406e100 tx=0x7f402001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd75d1040e2c3ab server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:24.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f4033e00640 1 -- 172.21.15.119:0/1665024611 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200ab660 con 0x7f403413f2c0 2024-03-08T21:34:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f4033e00640 1 -- 172.21.15.119:0/1665024611 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200b0070 con 0x7f403413f2c0 2024-03-08T21:34:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f4033e00640 1 -- 172.21.15.119:0/1665024611 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200aba20 con 0x7f403413f2c0 2024-03-08T21:34:24.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 -- 172.21.15.119:0/1665024611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 msgr2=0x7f403409a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 --2- 172.21.15.119:0/1665024611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f403409a8d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f403406e100 tx=0x7f402001c480 comp rx=0 tx=0).stop 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 -- 172.21.15.119:0/1665024611 shutdown_connections 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 --2- 172.21.15.119:0/1665024611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40340b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 --2- 172.21.15.119:0/1665024611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f403409a8d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 --2- 172.21.15.119:0/1665024611 >> v2:172.21.15.160:3300/0 conn(0x7f4034099ca0 0x7f403413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 -- 172.21.15.119:0/1665024611 >> 172.21.15.119:0/1665024611 conn(0x7f403406c620 msgr2=0x7f403406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 -- 172.21.15.119:0/1665024611 shutdown_connections 2024-03-08T21:34:24.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.657+0000 7f403c200640 1 -- 172.21.15.119:0/1665024611 wait complete. 2024-03-08T21:34:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 Processor -- start 2024-03-08T21:34:24.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- start start 2024-03-08T21:34:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 0x7f40340aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40341dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340b5b50 con 0x7f403413f2c0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340b59d0 con 0x7f4034099ca0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40340b5cd0 con 0x7f403409ae10 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43284/0 (socket says 172.21.15.119:43284) 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 -- 172.21.15.119:0/733844326 learned_addr learned my addr 172.21.15.119:0/733844326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4038e00640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40341dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 -- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 msgr2=0x7f40341dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40341dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 -- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 msgr2=0x7f40340aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4039800640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 0x7f40340aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 0x7f40340aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 -- 172.21.15.119:0/733844326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4034145a60 con 0x7f403413f2c0 2024-03-08T21:34:24.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4039800640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 0x7f40340aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403a200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f402c00efc0 tx=0x7f402c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00cd20 con 0x7f403413f2c0 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c0039a0 con 0x7f403413f2c0 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4034145150 con 0x7f403413f2c0 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c003d90 con 0x7f403413f2c0 2024-03-08T21:34:24.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4034072730 con 0x7f403413f2c0 2024-03-08T21:34:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.661+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034067db0 con 0x7f403413f2c0 2024-03-08T21:34:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.665+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f402c012050 con 0x7f403413f2c0 2024-03-08T21:34:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.665+0000 7f4031600640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 0x7f4014069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.665+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f402c085a00 con 0x7f403413f2c0 2024-03-08T21:34:24.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.665+0000 7f4039800640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 0x7f4014069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:24.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.665+0000 7f4039800640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 0x7f4014069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4028009ae0 tx=0x7f4028008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:24.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.669+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f402c010040 con 0x7f403413f2c0 2024-03-08T21:34:24.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f40340684c0 con 0x7f403413f2c0 2024-03-08T21:34:24.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f4031600640 1 -- 172.21.15.119:0/733844326 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5207 (secure 0 0 0) 0x7f402c0569c0 con 0x7f403413f2c0 2024-03-08T21:34:24.869 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:24.869 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "auth_dump": [ 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.a", 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAChOtlY12TBhAAn0kx0+ksiHAFJKh8GVAtpQ==", 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.870 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mds.b", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAChOtlpC8qCxAAAhxEEOqRipl6e9evxf56RQ==", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.0", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAFhOtlHFBkFxAAEcq02Y3WFI5K6n+MuEIoDQ==", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.871 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.1", 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAIhOtl1B4oHRAAeMgCpSTfbyIHGP6i0RR3Pw==", 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.2", 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQALhOtlR/rSIRAAKl9zzcA+lt40OMrvWvptWQ==", 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.3", 2024-03-08T21:34:24.873 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAOhOtlV5jOJxAAY4euw+gZXZLrtqNDI51SHw==", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.4", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAUhOtlhQnBKxAAqii6bYDAxAPy7EL7r4LkCQ==", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.5", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAXhOtlDBB4MRAA/QGz2XvWC01zy7GDaprezQ==", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.6", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAahOtlZtUrNhAADi6IwmFkw1S2CK4IdDlIuw==", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.875 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "osd.7", 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAdhOtlhS71OhAA/1hG6LLZZcIYtwZS8jDfgg==", 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow profile osd", 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile osd", 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.876 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.0", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAChOtlvC0jDxAA1g3YPVNdL51JtIDGrFOacQ==", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow r", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow rw", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow rwx" 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.admin", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABhOtlAqkwJxAA7yJJypMds3WFXdjfHRjSLw==", 2024-03-08T21:34:24.877 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "mgr": "allow *", 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow *", 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mds", 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlBtESFhAAsKKvHcJz+PWsv29M0l9+AA==", 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mds" 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-mgr", 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlqNsSFhAA426RAqADrJBcA/u4mz64tQ==", 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-osd", 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlUeUSFhAA6AsLOvsZMC3dWFF0wLCLNw==", 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-osd" 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd", 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlPe8SFhAA5+JvQuYsaqGAFjzDGFbm7w==", 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlUvgSFhAAgS2gaV2bsiz6sBe0uq8OgA==", 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "client.bootstrap-rgw", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAjhOtlfwETFhAADABMUoL55DOjCsB2lGaNgg==", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.x", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQAChOtlmkJ/AhAAFFLqfWIRVTBRT21l6bos6A==", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "entity": "mgr.y", 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "key": "AQABhOtlVoqLOhAAaGWMOo6MoWIXlRCw3n8x/A==", 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": { 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": "allow *", 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "mon": "allow profile mgr", 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: "osd": "allow *" 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-03-08T21:34:24.882 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:24.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 msgr2=0x7f4014069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 0x7f4014069b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4028009ae0 tx=0x7f4028008040 comp rx=0 tx=0).stop 2024-03-08T21:34:24.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 msgr2=0x7f40341e0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:24.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f402c00efc0 tx=0x7f402c00c490 comp rx=0 tx=0).stop 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 shutdown_connections 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4014067660 0x7f4014069b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f403413f2c0 0x7f40341e0440 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f403409ae10 0x7f40341dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 --2- 172.21.15.119:0/733844326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4034099ca0 0x7f40340aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.881+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 >> 172.21.15.119:0/733844326 conn(0x7f403406c620 msgr2=0x7f4034073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.885+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 shutdown_connections 2024-03-08T21:34:24.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:24.885+0000 7f403c200640 1 -- 172.21.15.119:0/733844326 wait complete. 2024-03-08T21:34:24.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-08T21:34:25.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 Processor -- start 2024-03-08T21:34:25.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 -- start start 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e809b190 con 0x7f92e81448b0 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e809d240 con 0x7f92e809adb0 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92ed600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e809d520 con 0x7f92e8072fe0 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92e7400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f92e81448b0 0x7f92e813d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54266/0 (socket says 172.21.15.119:54266) 2024-03-08T21:34:25.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92e7400640 1 -- 172.21.15.119:0/1991486659 learned_addr learned my addr 172.21.15.119:0/1991486659 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.037+0000 7f92e6000640 1 --2- 172.21.15.119:0/1991486659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e5600640 1 -- 172.21.15.119:0/1991486659 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29103521 0 0) 0x7f92e809b190 con 0x7f92e81448b0 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e5600640 1 -- 172.21.15.119:0/1991486659 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92cc003530 con 0x7f92e81448b0 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e6000640 1 -- 172.21.15.119:0/1991486659 >> v1:172.21.15.160:6789/0 conn(0x7f92e809adb0 legacy=0x7f92e81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e6000640 1 -- 172.21.15.119:0/1991486659 >> v1:172.21.15.119:6789/0 conn(0x7f92e81448b0 legacy=0x7f92e813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e6000640 1 -- 172.21.15.119:0/1991486659 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8143c50 con 0x7f92e8072fe0 2024-03-08T21:34:25.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e6000640 1 --2- 172.21.15.119:0/1991486659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e809cbf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92d40097f0 tx=0x7f92d401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef35a04196ad1cd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e5600640 1 -- 172.21.15.119:0/1991486659 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40aa660 con 0x7f92e8072fe0 2024-03-08T21:34:25.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e5600640 1 -- 172.21.15.119:0/1991486659 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d40af070 con 0x7f92e8072fe0 2024-03-08T21:34:25.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.041+0000 7f92e5600640 1 -- 172.21.15.119:0/1991486659 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40aaa00 con 0x7f92e8072fe0 2024-03-08T21:34:25.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/1991486659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 msgr2=0x7f92e809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 --2- 172.21.15.119:0/1991486659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e809cbf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92d40097f0 tx=0x7f92d401c4e0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/1991486659 shutdown_connections 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 --2- 172.21.15.119:0/1991486659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e809cbf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/1991486659 >> 172.21.15.119:0/1991486659 conn(0x7f92e806c620 msgr2=0x7f92e806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/1991486659 shutdown_connections 2024-03-08T21:34:25.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/1991486659 wait complete. 2024-03-08T21:34:25.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 Processor -- start 2024-03-08T21:34:25.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- start start 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e813e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92e81448b0 0x7f92e80b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8152190 con 0x7f92e809adb0 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8152010 con 0x7f92e81448b0 2024-03-08T21:34:25.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8152310 con 0x7f92e8072fe0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43288/0 (socket says 172.21.15.119:43288) 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 -- 172.21.15.119:0/2864272583 learned_addr learned my addr 172.21.15.119:0/2864272583 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6a00640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e813e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e7400640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92e81448b0 0x7f92e80b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 -- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 msgr2=0x7f92e813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e813e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 -- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92e81448b0 msgr2=0x7f92e80b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92e81448b0 0x7f92e80b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 -- 172.21.15.119:0/2864272583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8072b30 con 0x7f92e809adb0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92e6000640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92d40097f0 tx=0x7f92d401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4004230 con 0x7f92e809adb0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d40043d0 con 0x7f92e809adb0 2024-03-08T21:34:25.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d4003860 con 0x7f92e809adb0 2024-03-08T21:34:25.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80b7460 con 0x7f92e809adb0 2024-03-08T21:34:25.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.045+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e81433d0 con 0x7f92e809adb0 2024-03-08T21:34:25.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8067db0 con 0x7f92e809adb0 2024-03-08T21:34:25.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f92d4003a00 con 0x7f92e809adb0 2024-03-08T21:34:25.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92dea00640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 0x7f92c8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92d4120200 con 0x7f92e809adb0 2024-03-08T21:34:25.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92e6a00640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 0x7f92c8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.049+0000 7f92e6a00640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 0x7f92c8069b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001d50 tx=0x7f92d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.053+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f92d40160d0 con 0x7f92e809adb0 2024-03-08T21:34:25.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.265+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f92e8140d80 con 0x7f92e809adb0 2024-03-08T21:34:25.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92dea00640 1 -- 172.21.15.119:0/2864272583 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92d40f12e0 con 0x7f92e809adb0 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 msgr2=0x7f92c8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 0x7f92c8069b20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f92d8001d50 tx=0x7f92d8009040 comp rx=0 tx=0).stop 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 msgr2=0x7f92e813f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92d40097f0 tx=0x7f92d401ad20 comp rx=0 tx=0).stop 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 shutdown_connections 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f92c8067660 0x7f92c8069b20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92e81448b0 0x7f92e80b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e809adb0 0x7f92e813f920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 --2- 172.21.15.119:0/2864272583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92e8072fe0 0x7f92e813e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 >> 172.21.15.119:0/2864272583 conn(0x7f92e806c620 msgr2=0x7f92e813d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:25.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 shutdown_connections 2024-03-08T21:34:25.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.269+0000 7f92ed600640 1 -- 172.21.15.119:0/2864272583 wait complete. 2024-03-08T21:34:25.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-08T21:34:25.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 Processor -- start 2024-03-08T21:34:25.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 -- start start 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3e3c099ca0 0x7f3e3c13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c09a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b4b60 con 0x7f3e3c09ae10 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c09a080 con 0x7f3e3c099ca0 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e42800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b4510 con 0x7f3e3c13f2c0 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43304/0 (socket says 172.21.15.119:43304) 2024-03-08T21:34:25.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 -- 172.21.15.119:0/824289721 learned_addr learned my addr 172.21.15.119:0/824289721 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3aa00640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c09a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3b400640 1 --2- 172.21.15.119:0/824289721 >> v2:172.21.15.160:3300/0 conn(0x7f3e3c099ca0 0x7f3e3c13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 -- 172.21.15.119:0/824289721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 msgr2=0x7f3e3c09a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c09a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 -- 172.21.15.119:0/824289721 >> v2:172.21.15.160:3300/0 conn(0x7f3e3c099ca0 msgr2=0x7f3e3c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 --2- 172.21.15.119:0/824289721 >> v2:172.21.15.160:3300/0 conn(0x7f3e3c099ca0 0x7f3e3c13ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.425+0000 7f3e3be00640 1 -- 172.21.15.119:0/824289721 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0b47f0 con 0x7f3e3c09ae10 2024-03-08T21:34:25.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e3be00640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c06e100 tx=0x7f3e3401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df6f489c88610c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e3a000640 1 -- 172.21.15.119:0/824289721 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a5780 con 0x7f3e3c09ae10 2024-03-08T21:34:25.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e3a000640 1 -- 172.21.15.119:0/824289721 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a5920 con 0x7f3e3c09ae10 2024-03-08T21:34:25.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e3a000640 1 -- 172.21.15.119:0/824289721 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a5cf0 con 0x7f3e3c09ae10 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- 172.21.15.119:0/824289721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 msgr2=0x7f3e3c0b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c06e100 tx=0x7f3e3401c9f0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- 172.21.15.119:0/824289721 shutdown_connections 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c0b1d30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- 172.21.15.119:0/824289721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c09a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- 172.21.15.119:0/824289721 >> v2:172.21.15.160:3300/0 conn(0x7f3e3c099ca0 0x7f3e3c13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- 172.21.15.119:0/824289721 >> 172.21.15.119:0/824289721 conn(0x7f3e3c06c620 msgr2=0x7f3e3c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- 172.21.15.119:0/824289721 shutdown_connections 2024-03-08T21:34:25.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- 172.21.15.119:0/824289721 wait complete. 2024-03-08T21:34:25.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 Processor -- start 2024-03-08T21:34:25.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- start start 2024-03-08T21:34:25.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 0x7f3e3c1ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b5b50 con 0x7f3e3c09ae10 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b59d0 con 0x7f3e3c099ca0 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.429+0000 7f3e42800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b5cd0 con 0x7f3e3c13f2c0 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43308/0 (socket says 172.21.15.119:43308) 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 -- 172.21.15.119:0/1946909763 learned_addr learned my addr 172.21.15.119:0/1946909763 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3b400640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 0x7f3e3c1ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3be00640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 -- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 msgr2=0x7f3e3c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 -- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 msgr2=0x7f3e3c1ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 0x7f3e3c1ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 -- 172.21.15.119:0/1946909763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c145700 con 0x7f3e3c09ae10 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3b400640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 0x7f3e3c1ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:25.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3be00640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e3aa00640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d830 tx=0x7f3e2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800b6c0 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28019070 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c145140 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800bae0 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c141e80 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c067db0 con 0x7f3e3c09ae10 2024-03-08T21:34:25.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3e2801e460 con 0x7f3e3c09ae10 2024-03-08T21:34:25.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.433+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3e28085c60 con 0x7f3e3c09ae10 2024-03-08T21:34:25.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.437+0000 7f3e3b400640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.437+0000 7f3e3b400640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 0x7f3e1c069b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.441+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f3e28056c20 con 0x7f3e3c09ae10 2024-03-08T21:34:25.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.649+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3e3c0b3920 con 0x7f3e3c09ae10 2024-03-08T21:34:25.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.653+0000 7f3e33400640 1 -- 172.21.15.119:0/1946909763 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3e28056520 con 0x7f3e3c09ae10 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 msgr2=0x7f3e1c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 0x7f3e1c069b20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 msgr2=0x7f3e3c13fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d830 tx=0x7f3e2800dcf0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 shutdown_connections 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3e1c067660 0x7f3e1c069b20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e3c13f2c0 0x7f3e3c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e3c09ae10 0x7f3e3c13fb30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 --2- 172.21.15.119:0/1946909763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e3c099ca0 0x7f3e3c1ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 >> 172.21.15.119:0/1946909763 conn(0x7f3e3c06c620 msgr2=0x7f3e3c13cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:25.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 shutdown_connections 2024-03-08T21:34:25.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.657+0000 7f3e42800640 1 -- 172.21.15.119:0/1946909763 wait complete. 2024-03-08T21:34:25.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-08T21:34:25.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 Processor -- start 2024-03-08T21:34:25.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 -- start start 2024-03-08T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f450409adb0 0x7f450409cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f45041448b0 0x7f450413d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450409b190 con 0x7f4504072fe0 2024-03-08T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450409d240 con 0x7f45041448b0 2024-03-08T21:34:25.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.809+0000 7f450a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450409d520 con 0x7f450409adb0 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f45041448b0 0x7f450413d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f450409adb0 0x7f450409cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f45041448b0 0x7f450413d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:51380/0 (socket says 172.21.15.119:51380) 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 -- 172.21.15.119:0/1397682150 learned_addr learned my addr 172.21.15.119:0/1397682150 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4502a00640 1 --1- 172.21.15.119:0/1397682150 >> v1:172.21.15.160:6789/0 conn(0x7f4504072fe0 0x7f45041441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:48808/0 (socket says 172.21.15.119:48808) 2024-03-08T21:34:25.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 -- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f450409adb0 msgr2=0x7f450409cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:25.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 --2- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f450409adb0 0x7f450409cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 -- 172.21.15.119:0/1397682150 >> v1:172.21.15.160:6789/0 conn(0x7f4504072fe0 legacy=0x7f45041441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 -- 172.21.15.119:0/1397682150 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504143c50 con 0x7f45041448b0 2024-03-08T21:34:25.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4503e00640 1 --2- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450413d9e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009870 tx=0x7f44fc01e770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a7aa22a6878bb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4502000640 1 -- 172.21.15.119:0/1397682150 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0aa660 con 0x7f45041448b0 2024-03-08T21:34:25.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4502000640 1 -- 172.21.15.119:0/1397682150 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc0aa800 con 0x7f45041448b0 2024-03-08T21:34:25.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.813+0000 7f4502000640 1 -- 172.21.15.119:0/1397682150 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0aabd0 con 0x7f45041448b0 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 msgr2=0x7f450413d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450413d9e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009870 tx=0x7f44fc01e770 comp rx=0 tx=0).stop 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- 172.21.15.119:0/1397682150 shutdown_connections 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450413d9e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- 172.21.15.119:0/1397682150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f450409adb0 0x7f450409cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- 172.21.15.119:0/1397682150 >> 172.21.15.119:0/1397682150 conn(0x7f450406c620 msgr2=0x7f450406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:25.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- 172.21.15.119:0/1397682150 shutdown_connections 2024-03-08T21:34:25.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- 172.21.15.119:0/1397682150 wait complete. 2024-03-08T21:34:25.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 Processor -- start 2024-03-08T21:34:25.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- start start 2024-03-08T21:34:25.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 0x7f4504072370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450406f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450409a5e0 con 0x7f450409adb0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450409a460 con 0x7f45041448b0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f450a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450409a760 con 0x7f4504072fe0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43316/0 (socket says 172.21.15.119:43316) 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 -- 172.21.15.119:0/3219013893 learned_addr learned my addr 172.21.15.119:0/3219013893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4503e00640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450406f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4503400640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 0x7f4504072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 -- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 msgr2=0x7f4504072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 0x7f4504072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 -- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 msgr2=0x7f450406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450406f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 -- 172.21.15.119:0/3219013893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040728b0 con 0x7f450409adb0 2024-03-08T21:34:25.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4503e00640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4503400640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 0x7f4504072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.817+0000 7f4502a00640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c430 tx=0x7f44f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00074e0 con 0x7f450409adb0 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f0007680 con 0x7f450409adb0 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0004a30 con 0x7f450409adb0 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504071680 con 0x7f450409adb0 2024-03-08T21:34:25.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450413f480 con 0x7f450409adb0 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4504067db0 con 0x7f450409adb0 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f44f001a020 con 0x7f450409adb0 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 0x7f44e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44f0084db0 con 0x7f450409adb0 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f4503400640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 0x7f44e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:25.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.821+0000 7f4503400640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 0x7f44e4069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44f4007520 tx=0x7f44f400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:25.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:25.825+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f44f0089070 con 0x7f450409adb0 2024-03-08T21:34:26.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.033+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f450413ccf0 con 0x7f450409adb0 2024-03-08T21:34:26.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.037+0000 7f44fb400640 1 -- 172.21.15.119:0/3219013893 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f45040728b0 con 0x7f450409adb0 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 msgr2=0x7f44e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 0x7f44e4069b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44f4007520 tx=0x7f44f400b040 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 msgr2=0x7f45040b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c430 tx=0x7f44f000c8f0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 shutdown_connections 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f44e4067660 0x7f44e4069b20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45041448b0 0x7f450406f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f450409adb0 0x7f45040b14e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 --2- 172.21.15.119:0/3219013893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4504072fe0 0x7f4504072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 >> 172.21.15.119:0/3219013893 conn(0x7f450406c620 msgr2=0x7f4504073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 shutdown_connections 2024-03-08T21:34:26.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.041+0000 7f450a800640 1 -- 172.21.15.119:0/3219013893 wait complete. 2024-03-08T21:34:26.047 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-08T21:34:26.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 Processor -- start 2024-03-08T21:34:26.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 -- start start 2024-03-08T21:34:26.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb04099ca0 0x7fdb0413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdb0413f2c0 0x7fdb0409a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0409ae10 0x7fdb040b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0409b240 con 0x7fdb04099ca0 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040b4b60 con 0x7fdb0413f2c0 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb09c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0409a080 con 0x7fdb0409ae10 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb04099ca0 0x7fdb0413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb04099ca0 0x7fdb0413ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43328/0 (socket says 172.21.15.119:43328) 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 -- 172.21.15.119:0/617412253 learned_addr learned my addr 172.21.15.119:0/617412253 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02000640 1 --2- 172.21.15.119:0/617412253 >> v2:172.21.15.160:3300/0 conn(0x7fdb0413f2c0 0x7fdb0409a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb03400640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0409ae10 0x7fdb040b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 -- 172.21.15.119:0/617412253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0409ae10 msgr2=0x7fdb040b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0409ae10 0x7fdb040b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 -- 172.21.15.119:0/617412253 >> v2:172.21.15.160:3300/0 conn(0x7fdb0413f2c0 msgr2=0x7fdb0409a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 --2- 172.21.15.119:0/617412253 >> v2:172.21.15.160:3300/0 conn(0x7fdb0413f2c0 0x7fdb0409a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.193+0000 7fdb02a00640 1 -- 172.21.15.119:0/617412253 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040b4510 con 0x7fdb04099ca0 2024-03-08T21:34:26.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb02a00640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb0413ed80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdb0409a330 tx=0x7fdaf401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae901eec3589bd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb01600640 1 -- 172.21.15.119:0/617412253 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40aa660 con 0x7fdb04099ca0 2024-03-08T21:34:26.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb01600640 1 -- 172.21.15.119:0/617412253 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40af070 con 0x7fdb04099ca0 2024-03-08T21:34:26.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb01600640 1 -- 172.21.15.119:0/617412253 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40aaa20 con 0x7fdb04099ca0 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 -- 172.21.15.119:0/617412253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 msgr2=0x7fdb0413ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb0413ed80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdb0409a330 tx=0x7fdaf401c520 comp rx=0 tx=0).stop 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 -- 172.21.15.119:0/617412253 shutdown_connections 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0409ae10 0x7fdb040b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 --2- 172.21.15.119:0/617412253 >> v2:172.21.15.160:3300/0 conn(0x7fdb0413f2c0 0x7fdb0409a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 --2- 172.21.15.119:0/617412253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb0413ed80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 -- 172.21.15.119:0/617412253 >> 172.21.15.119:0/617412253 conn(0x7fdb0406c620 msgr2=0x7fdb0406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 -- 172.21.15.119:0/617412253 shutdown_connections 2024-03-08T21:34:26.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.197+0000 7fdb09c00640 1 -- 172.21.15.119:0/617412253 wait complete. 2024-03-08T21:34:26.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 Processor -- start 2024-03-08T21:34:26.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- start start 2024-03-08T21:34:26.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb0409ae10 0x7fdb041404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0413f2c0 0x7fdb041421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040b5b50 con 0x7fdb04099ca0 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040b59d0 con 0x7fdb0409ae10 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040b5cd0 con 0x7fdb0413f2c0 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43340/0 (socket says 172.21.15.119:43340) 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 -- 172.21.15.119:0/3393728865 learned_addr learned my addr 172.21.15.119:0/3393728865 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb03400640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0413f2c0 0x7fdb041421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02000640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb0409ae10 0x7fdb041404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 -- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0413f2c0 msgr2=0x7fdb041421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0413f2c0 0x7fdb041421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 -- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb0409ae10 msgr2=0x7fdb041404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb0409ae10 0x7fdb041404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 -- 172.21.15.119:0/3393728865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb04141800 con 0x7fdb04099ca0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb02a00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401abd0 tx=0x7fdaf401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40bd5f0 con 0x7fdb04099ca0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40bd790 con 0x7fdb04099ca0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40bdb80 con 0x7fdb04099ca0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb041452c0 con 0x7fdb04099ca0 2024-03-08T21:34:26.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.201+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb04145be0 con 0x7fdb04099ca0 2024-03-08T21:34:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb04067db0 con 0x7fdb04099ca0 2024-03-08T21:34:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdaf40b33f0 con 0x7fdb04099ca0 2024-03-08T21:34:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdafaa00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 0x7fdae4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdaf411fe50 con 0x7fdb04099ca0 2024-03-08T21:34:26.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdb02000640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 0x7fdae4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.205+0000 7fdb02000640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 0x7fdae4069b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb0414f510 tx=0x7fdaf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.209+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fdaf4016110 con 0x7fdb04099ca0 2024-03-08T21:34:26.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.417+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdb040b3920 con 0x7fdb04099ca0 2024-03-08T21:34:26.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.421+0000 7fdafaa00640 1 -- 172.21.15.119:0/3393728865 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdaf40f0850 con 0x7fdb04099ca0 2024-03-08T21:34:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 msgr2=0x7fdae4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 0x7fdae4069b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb0414f510 tx=0x7fdaf0008040 comp rx=0 tx=0).stop 2024-03-08T21:34:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 msgr2=0x7fdb041ddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdaf401abd0 tx=0x7fdaf401ad60 comp rx=0 tx=0).stop 2024-03-08T21:34:26.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 shutdown_connections 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdae4067690 0x7fdae4069b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb0413f2c0 0x7fdb041421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb0409ae10 0x7fdb041404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 --2- 172.21.15.119:0/3393728865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb04099ca0 0x7fdb041ddb10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 >> 172.21.15.119:0/3393728865 conn(0x7fdb0406c620 msgr2=0x7fdb04073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 shutdown_connections 2024-03-08T21:34:26.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.425+0000 7fdb09c00640 1 -- 172.21.15.119:0/3393728865 wait complete. 2024-03-08T21:34:26.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-08T21:34:26.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 Processor -- start 2024-03-08T21:34:26.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 -- start start 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba1809a8d0 0x7fba1809ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba180b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180b26a0 con 0x7fba18099ca0 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180b4b60 con 0x7fba1809a8d0 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1fc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1809a080 con 0x7fba180b1d30 2024-03-08T21:34:26.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba17e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba1809a8d0 0x7fba1809ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.577+0000 7fba1d200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fba18099ca0 0x7fba1813ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54276/0 (socket says 172.21.15.119:54276) 2024-03-08T21:34:26.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba1809a8d0 0x7fba1809ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43344/0 (socket says 172.21.15.119:43344) 2024-03-08T21:34:26.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba1d200640 1 -- 172.21.15.119:0/3407285947 learned_addr learned my addr 172.21.15.119:0/3407285947 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:26.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba1dc00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba180b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 -- 172.21.15.119:0/3407285947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 msgr2=0x7fba180b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba180b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 -- 172.21.15.119:0/3407285947 >> v1:172.21.15.119:6789/0 conn(0x7fba18099ca0 legacy=0x7fba1813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17400640 1 -- 172.21.15.119:0/3407285947 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180470068 0 0) 0x7fba180b26a0 con 0x7fba18099ca0 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 -- 172.21.15.119:0/3407285947 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180b4510 con 0x7fba1809a8d0 2024-03-08T21:34:26.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba1dc00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba180b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:26.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17e00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba1809a8d0 0x7fba1809ad40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba040097c0 tx=0x7fba0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8d2c55d281a382 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17400640 1 -- 172.21.15.119:0/3407285947 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040b1070 con 0x7fba1809a8d0 2024-03-08T21:34:26.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17400640 1 -- 172.21.15.119:0/3407285947 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040ac410 con 0x7fba1809a8d0 2024-03-08T21:34:26.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba17400640 1 -- 172.21.15.119:0/3407285947 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040ac7e0 con 0x7fba1809a8d0 2024-03-08T21:34:26.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba1fc00640 1 -- 172.21.15.119:0/3407285947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba1809a8d0 msgr2=0x7fba1809ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.581+0000 7fba1fc00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba1809a8d0 0x7fba1809ad40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba040097c0 tx=0x7fba0401c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/3407285947 shutdown_connections 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba180b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 --2- 172.21.15.119:0/3407285947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba1809a8d0 0x7fba1809ad40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/3407285947 >> 172.21.15.119:0/3407285947 conn(0x7fba1806c620 msgr2=0x7fba1806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/3407285947 shutdown_connections 2024-03-08T21:34:26.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/3407285947 wait complete. 2024-03-08T21:34:26.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 Processor -- start 2024-03-08T21:34:26.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- start start 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 0x7fba181dd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba181e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181522d0 con 0x7fba18099ca0 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18152150 con 0x7fba1809a8d0 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba18152450 con 0x7fba180b1d30 2024-03-08T21:34:26.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43356/0 (socket says 172.21.15.119:43356) 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 -- 172.21.15.119:0/461858016 learned_addr learned my addr 172.21.15.119:0/461858016 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba17e00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 0x7fba181dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1dc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba181e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 -- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 msgr2=0x7fba181e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba181e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 -- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 msgr2=0x7fba181dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 0x7fba181dd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 -- 172.21.15.119:0/461858016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18141200 con 0x7fba18099ca0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba17e00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 0x7fba181dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1d200640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c520 tx=0x7fba0c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c018070 con 0x7fba18099ca0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c0074e0 con 0x7fba18099ca0 2024-03-08T21:34:26.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba18144bf0 con 0x7fba18099ca0 2024-03-08T21:34:26.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0049f0 con 0x7fba18099ca0 2024-03-08T21:34:26.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.585+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18143e90 con 0x7fba18099ca0 2024-03-08T21:34:26.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba180b8330 con 0x7fba18099ca0 2024-03-08T21:34:26.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fba0c01b070 con 0x7fba18099ca0 2024-03-08T21:34:26.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba14c00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 0x7fb9f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba0c084950 con 0x7fba18099ca0 2024-03-08T21:34:26.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba17e00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 0x7fb9f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.589+0000 7fba17e00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 0x7fb9f8069b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba040ae000 tx=0x7fba040a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.593+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fba0c055910 con 0x7fba18099ca0 2024-03-08T21:34:26.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.801+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fba1813fc10 con 0x7fba18099ca0 2024-03-08T21:34:26.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.805+0000 7fba14c00640 1 -- 172.21.15.119:0/461858016 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba0c055210 con 0x7fba18099ca0 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 msgr2=0x7fb9f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 0x7fb9f8069b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba040ae000 tx=0x7fba040a6040 comp rx=0 tx=0).stop 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 msgr2=0x7fba1809cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c520 tx=0x7fba0c00c9e0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 shutdown_connections 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb9f8067660 0x7fb9f8069b20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba180b1d30 0x7fba181e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba1809a8d0 0x7fba181dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 --2- 172.21.15.119:0/461858016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba18099ca0 0x7fba1809cae0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 >> 172.21.15.119:0/461858016 conn(0x7fba1806c620 msgr2=0x7fba1806ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 shutdown_connections 2024-03-08T21:34:26.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.809+0000 7fba1fc00640 1 -- 172.21.15.119:0/461858016 wait complete. 2024-03-08T21:34:26.815 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-08T21:34:26.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.961+0000 7f8250a00640 1 Processor -- start 2024-03-08T21:34:26.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.961+0000 7f8250a00640 1 -- start start 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8250a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f824c09a8d0 0x7f824c09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8250a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c09a080 con 0x7f824c099ca0 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8250a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c0b4510 con 0x7f824c0b1d30 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8250a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0b4b60 con 0x7f824c09a8d0 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f824c099ca0 0x7f824c13ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54288/0 (socket says 172.21.15.119:54288) 2024-03-08T21:34:26.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249e00640 1 -- 172.21.15.119:0/3791943629 learned_addr learned my addr 172.21.15.119:0/3791943629 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:26.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 --2- 172.21.15.119:0/3791943629 >> v2:172.21.15.160:3300/0 conn(0x7f824c09a8d0 0x7f824c09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115763685 0 0) 0x7f824c09a080 con 0x7f824c099ca0 2024-03-08T21:34:26.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8230003530 con 0x7f824c099ca0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564034424 0 0) 0x7f8230003530 con 0x7f824c099ca0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 >> v2:172.21.15.160:3300/0 conn(0x7f824c09a8d0 msgr2=0x7f824c09ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 --2- 172.21.15.119:0/3791943629 >> v2:172.21.15.160:3300/0 conn(0x7f824c09a8d0 0x7f824c09ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 >> v1:172.21.15.160:6789/0 conn(0x7f824c0b1d30 legacy=0x7f824c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0b47f0 con 0x7f824c099ca0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f823c001680 con 0x7f824c099ca0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 >> v1:172.21.15.119:6789/0 conn(0x7f824c099ca0 legacy=0x7f824c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82300039c0 0x7f8230003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 0x7f8230004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82300051d0 0x7f823000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b4b60 con 0x7f8230004810 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823000c070 con 0x7f82300039c0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823000c270 con 0x7f82300051d0 2024-03-08T21:34:26.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 0x7f8230004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8249e00640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82300039c0 0x7f8230003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f824a800640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82300051d0 0x7f823000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 -- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82300051d0 msgr2=0x7f823000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82300051d0 0x7f823000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 -- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82300039c0 msgr2=0x7f8230003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82300039c0 0x7f8230003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f8241400640 1 -- 172.21.15.119:0/3791943629 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8230003530 con 0x7f8230004810 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f824a800640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82300051d0 0x7f823000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:26.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.965+0000 7f824a800640 1 -- 172.21.15.119:0/3791943629 reap_dead start 2024-03-08T21:34:26.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8241400640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 0x7f8230004c90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8234009fc0 tx=0x7f823401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747a091a1e2ae57 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82340b2070 con 0x7f8230004810 2024-03-08T21:34:26.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82340a5aa0 con 0x7f8230004810 2024-03-08T21:34:26.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8249400640 1 -- 172.21.15.119:0/3791943629 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234009c10 con 0x7f8230004810 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 msgr2=0x7f8230004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 0x7f8230004c90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8234009fc0 tx=0x7f823401cc80 comp rx=0 tx=0).stop 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- 172.21.15.119:0/3791943629 shutdown_connections 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 --2- 172.21.15.119:0/3791943629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8230004810 0x7f8230004c90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- 172.21.15.119:0/3791943629 >> 172.21.15.119:0/3791943629 conn(0x7f824c06c620 msgr2=0x7f824c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- 172.21.15.119:0/3791943629 shutdown_connections 2024-03-08T21:34:26.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- 172.21.15.119:0/3791943629 wait complete. 2024-03-08T21:34:26.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 Processor -- start 2024-03-08T21:34:26.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.969+0000 7f8250a00640 1 -- start start 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8230004810 0x7f824c09c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f824c140620 0x7f824c141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c09b0d0 con 0x7f824c13df50 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c09af50 con 0x7f824c140620 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b2140 con 0x7f8230004810 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43372/0 (socket says 172.21.15.119:43372) 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 -- 172.21.15.119:0/3202125679 learned_addr learned my addr 172.21.15.119:0/3202125679 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8241400640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f824c140620 0x7f824c141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8249e00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8230004810 0x7f824c09c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 -- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8230004810 msgr2=0x7f824c09c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8230004810 0x7f824c09c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 -- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f824c140620 msgr2=0x7f824c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:26.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f824c140620 0x7f824c141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:26.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 -- 172.21.15.119:0/3202125679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c141520 con 0x7f824c13df50 2024-03-08T21:34:26.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f824a800640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f824c06f6b0 tx=0x7f824400e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244019070 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82440050d0 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82440054a0 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c13fb60 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c141790 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c067db0 con 0x7f824c13df50 2024-03-08T21:34:26.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.973+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8244003600 con 0x7f824c13df50 2024-03-08T21:34:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.977+0000 7f8242a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 0x7f8228069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.977+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8244084400 con 0x7f824c13df50 2024-03-08T21:34:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.977+0000 7f8249e00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 0x7f8228069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:26.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.977+0000 7f8249e00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 0x7f8228069b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f823c007cd0 tx=0x7f823c007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:26.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:26.981+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f8244054d60 con 0x7f824c13df50 2024-03-08T21:34:27.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.189+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f824c0b5be0 con 0x7f824c13df50 2024-03-08T21:34:27.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.193+0000 7f8242a00640 1 -- 172.21.15.119:0/3202125679 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8244058e00 con 0x7f824c13df50 2024-03-08T21:34:27.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 msgr2=0x7f8228069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 0x7f8228069b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f823c007cd0 tx=0x7f823c007900 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 msgr2=0x7f824c1386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f824c06f6b0 tx=0x7f824400e760 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 shutdown_connections 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8228067690 0x7f8228069b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f824c13df50 0x7f824c1386d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f824c140620 0x7f824c141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 --2- 172.21.15.119:0/3202125679 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8230004810 0x7f824c09c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 >> 172.21.15.119:0/3202125679 conn(0x7f824c06c620 msgr2=0x7f824c144ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 shutdown_connections 2024-03-08T21:34:27.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.197+0000 7f8250a00640 1 -- 172.21.15.119:0/3202125679 wait complete. 2024-03-08T21:34:27.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 Processor -- start 2024-03-08T21:34:27.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 -- start start 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f91581483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580b7f80 con 0x7f9158144e60 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91581489f0 con 0x7f91580b7ba0 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f915e000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158148cd0 con 0x7f915813f330 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9157e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9158144e60 0x7f91581452f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54302/0 (socket says 172.21.15.119:54302) 2024-03-08T21:34:27.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9157e00640 1 -- 172.21.15.119:0/3683062999 learned_addr learned my addr 172.21.15.119:0/3683062999 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:27.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f91581483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854774573 0 0) 0x7f91580b7f80 con 0x7f9158144e60 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c003530 con 0x7f9158144e60 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519836171 0 0) 0x7f913c003530 con 0x7f9158144e60 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 msgr2=0x7f91581483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f91581483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 >> v1:172.21.15.160:6789/0 conn(0x7f91580b7ba0 legacy=0x7f915813ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580b72f0 con 0x7f9158144e60 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f9150001a00 con 0x7f9158144e60 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 >> v1:172.21.15.119:6789/0 conn(0x7f9158144e60 legacy=0x7f91581452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f913c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f913c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f913c004d50 0x7f913c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158148cd0 con 0x7f913c003f70 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c00bab0 con 0x7f913c004d50 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c00bcb0 con 0x7f915813f330 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f913c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9157400640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f913c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9157e00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f913c004d50 0x7f913c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 -- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 msgr2=0x7f913c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f913c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 -- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f913c004d50 msgr2=0x7f913c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f913c004d50 0x7f913c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9156a00640 1 -- 172.21.15.119:0/3683062999 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c003530 con 0x7f913c003f70 2024-03-08T21:34:27.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.349+0000 7f9157400640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f915813f330 0x7f913c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f9156a00640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f913c004810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9144009ae0 tx=0x7f914401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4828b58db1fbdc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440b2070 con 0x7f913c003f70 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91440a5550 con 0x7f913c003f70 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f9156000640 1 -- 172.21.15.119:0/3683062999 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440096b0 con 0x7f913c003f70 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 -- 172.21.15.119:0/3683062999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 msgr2=0x7f913c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 --2- 172.21.15.119:0/3683062999 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f913c004810 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9144009ae0 tx=0x7f914401ca70 comp rx=0 tx=0).stop 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f9157e00640 1 -- 172.21.15.119:0/3683062999 reap_dead start 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 -- 172.21.15.119:0/3683062999 shutdown_connections 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 -- 172.21.15.119:0/3683062999 >> 172.21.15.119:0/3683062999 conn(0x7f91580b94a0 msgr2=0x7f91580b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 -- 172.21.15.119:0/3683062999 shutdown_connections 2024-03-08T21:34:27.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.353+0000 7f915e000640 1 -- 172.21.15.119:0/3683062999 wait complete. 2024-03-08T21:34:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 Processor -- start 2024-03-08T21:34:27.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- start start 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f915809daf0 0x7f9158096800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9158096d40 0x7f91581dff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915809ea10 con 0x7f913c003f70 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580b74c0 con 0x7f915809daf0 2024-03-08T21:34:27.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91581483d0 con 0x7f9158096d40 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43394/0 (socket says 172.21.15.119:43394) 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 -- 172.21.15.119:0/4153910245 learned_addr learned my addr 172.21.15.119:0/4153910245 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 -- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9158096d40 msgr2=0x7f91581dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9158096d40 0x7f91581dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 -- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f915809daf0 msgr2=0x7f9158096800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f915809daf0 0x7f9158096800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 -- 172.21.15.119:0/4153910245 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915809af50 con 0x7f913c003f70 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f9157400640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f914800e810 tx=0x7f914800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480050d0 con 0x7f913c003f70 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148018070 con 0x7f913c003f70 2024-03-08T21:34:27.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915809b230 con 0x7f913c003f70 2024-03-08T21:34:27.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148003600 con 0x7f913c003f70 2024-03-08T21:34:27.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.357+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915809e180 con 0x7f913c003f70 2024-03-08T21:34:27.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9158067db0 con 0x7f913c003f70 2024-03-08T21:34:27.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f91480037a0 con 0x7f913c003f70 2024-03-08T21:34:27.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f914f400640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 0x7f9138069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9148085300 con 0x7f913c003f70 2024-03-08T21:34:27.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f9156a00640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 0x7f9138069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.361+0000 7f9156a00640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 0x7f9138069b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91440af000 tx=0x7f9144004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.365+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f9148056380 con 0x7f913c003f70 2024-03-08T21:34:27.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.521+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91581dfb30 con 0x7f913c003f70 2024-03-08T21:34:27.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f914f400640 1 -- 172.21.15.119:0/4153910245 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+12915 (secure 0 0 0) 0x7f9148055c80 con 0x7f913c003f70 2024-03-08T21:34:27.512 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:27.512 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":26,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:24.487835+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 msgr2=0x7f9138069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 0x7f9138069b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f91440af000 tx=0x7f9144004740 comp rx=0 tx=0).stop 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 msgr2=0x7f91580b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f914800e810 tx=0x7f914800ecd0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 shutdown_connections 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f9138067660 0x7f9138069b20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9158096d40 0x7f91581dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f915809daf0 0x7f9158096800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 --2- 172.21.15.119:0/4153910245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f913c003f70 0x7f91580b05f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 >> 172.21.15.119:0/4153910245 conn(0x7f91580b94a0 msgr2=0x7f91580b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:27.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 shutdown_connections 2024-03-08T21:34:27.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.525+0000 7f915e000640 1 -- 172.21.15.119:0/4153910245 wait complete. 2024-03-08T21:34:27.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:27.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:27.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.681+0000 7f41d6c00640 1 Processor -- start 2024-03-08T21:34:27.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.681+0000 7f41d6c00640 1 -- start start 2024-03-08T21:34:27.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41d6c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41d00b42b0 0x7f41d006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41d6c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d006e0b0 con 0x7f41d0145b30 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41d6c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d0145050 con 0x7f41d00b4690 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41d6c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d0142a90 con 0x7f41d00b42b0 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cfe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41d00b42b0 0x7f41d006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41c7400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f41d0145b30 0x7f41d0142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54312/0 (socket says 172.21.15.119:54312) 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41c7400640 1 -- 172.21.15.119:0/3243801248 learned_addr learned my addr 172.21.15.119:0/3243801248 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cfe00640 1 -- 172.21.15.119:0/3243801248 >> v1:172.21.15.160:6789/0 conn(0x7f41d00b4690 legacy=0x7f41d014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cfe00640 1 -- 172.21.15.119:0/3243801248 >> v1:172.21.15.119:6789/0 conn(0x7f41d0145b30 legacy=0x7f41d0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cfe00640 1 -- 172.21.15.119:0/3243801248 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0145330 con 0x7f41d00b42b0 2024-03-08T21:34:27.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cf400640 1 -- 172.21.15.119:0/3243801248 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668362644 0 0) 0x7f41d006e0b0 con 0x7f41d0145b30 2024-03-08T21:34:27.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.685+0000 7f41cfe00640 1 --2- 172.21.15.119:0/3243801248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b42b0 0x7f41d006c5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009d90 tx=0x7f41c001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5e1cff660ce932 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41cf400640 1 -- 172.21.15.119:0/3243801248 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00b2070 con 0x7f41d00b42b0 2024-03-08T21:34:27.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41cf400640 1 -- 172.21.15.119:0/3243801248 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c00a5760 con 0x7f41d00b42b0 2024-03-08T21:34:27.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41cf400640 1 -- 172.21.15.119:0/3243801248 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00a5b30 con 0x7f41d00b42b0 2024-03-08T21:34:27.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- 172.21.15.119:0/3243801248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b42b0 msgr2=0x7f41d006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3243801248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b42b0 0x7f41d006c5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009d90 tx=0x7f41c001c8a0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- 172.21.15.119:0/3243801248 shutdown_connections 2024-03-08T21:34:27.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3243801248 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b42b0 0x7f41d006c5e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- 172.21.15.119:0/3243801248 >> 172.21.15.119:0/3243801248 conn(0x7f41d009a230 msgr2=0x7f41d009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:27.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- 172.21.15.119:0/3243801248 shutdown_connections 2024-03-08T21:34:27.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- 172.21.15.119:0/3243801248 wait complete. 2024-03-08T21:34:27.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 Processor -- start 2024-03-08T21:34:27.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- start start 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41d00b42b0 0x7f41d00ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 0x7f41d01dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d0153830 con 0x7f41d00b4690 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00b3850 con 0x7f41d0145b30 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d6c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d01539b0 con 0x7f41d00b42b0 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43416/0 (socket says 172.21.15.119:43416) 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 -- 172.21.15.119:0/3908489689 learned_addr learned my addr 172.21.15.119:0/3908489689 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41cfe00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41d00b42b0 0x7f41d00ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d4c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 0x7f41d01dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 -- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41d00b42b0 msgr2=0x7f41d00ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41d00b42b0 0x7f41d00ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 -- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 msgr2=0x7f41d01dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 0x7f41d01dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41c7400640 1 -- 172.21.15.119:0/3908489689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0137740 con 0x7f41d00b4690 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.689+0000 7f41d4c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 0x7f41d01dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41c7400640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c450 tx=0x7f41b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8018070 con 0x7f41d00b4690 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b80074e0 con 0x7f41d00b4690 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b80049f0 con 0x7f41d00b4690 2024-03-08T21:34:27.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d01379c0 con 0x7f41d00b4690 2024-03-08T21:34:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d00af000 con 0x7f41d00b4690 2024-03-08T21:34:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00aeb30 con 0x7f41d00b4690 2024-03-08T21:34:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f41b8004b90 con 0x7f41d00b4690 2024-03-08T21:34:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 0x7f41ac069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41b80847c0 con 0x7f41d00b4690 2024-03-08T21:34:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.693+0000 7f41cfe00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 0x7f41ac069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.697+0000 7f41cfe00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 0x7f41ac069b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41c00af000 tx=0x7f41c00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:27.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.697+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f41d0137740 con 0x7f41d00b4690 2024-03-08T21:34:27.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41d0067db0 con 0x7f41d00b4690 2024-03-08T21:34:27.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41ccc00640 1 -- 172.21.15.119:0/3908489689 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41b8055130 con 0x7f41d00b4690 2024-03-08T21:34:27.844 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 msgr2=0x7f41ac069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 0x7f41ac069b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41c00af000 tx=0x7f41c00a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 msgr2=0x7f41d0137200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c450 tx=0x7f41b800c910 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 shutdown_connections 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f41ac067660 0x7f41ac069b20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41d0145b30 0x7f41d01dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41d00b4690 0x7f41d0137200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 --2- 172.21.15.119:0/3908489689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41d00b42b0 0x7f41d00ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 >> 172.21.15.119:0/3908489689 conn(0x7f41d009a230 msgr2=0x7f41d0142150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 shutdown_connections 2024-03-08T21:34:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:27.857+0000 7f41d6c00640 1 -- 172.21.15.119:0/3908489689 wait complete. 2024-03-08T21:34:27.865 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-08T21:34:27.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 Processor -- start 2024-03-08T21:34:27.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 -- start start 2024-03-08T21:34:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb07c09a8d0 0x7fb07c09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c09a080 con 0x7fb07c099ca0 2024-03-08T21:34:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0b4510 con 0x7fb07c0b1d30 2024-03-08T21:34:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb082200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0b4b60 con 0x7fb07c09a8d0 2024-03-08T21:34:28.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb07b400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb07c099ca0 0x7fb07c13ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54318/0 (socket says 172.21.15.119:54318) 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb07b400640 1 -- 172.21.15.119:0/1477289640 learned_addr learned my addr 172.21.15.119:0/1477289640 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.009+0000 7fb073e00640 1 --2- 172.21.15.119:0/1477289640 >> v2:172.21.15.160:3300/0 conn(0x7fb07c09a8d0 0x7fb07c09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460877156 0 0) 0x7fb07c09a080 con 0x7fb07c099ca0 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003530 con 0x7fb07c099ca0 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb073e00640 1 -- 172.21.15.119:0/1477289640 >> v1:172.21.15.160:6789/0 conn(0x7fb07c0b1d30 legacy=0x7fb07c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb073e00640 1 -- 172.21.15.119:0/1477289640 >> v1:172.21.15.119:6789/0 conn(0x7fb07c099ca0 legacy=0x7fb07c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484464299 0 0) 0x7fb060003530 con 0x7fb07c099ca0 2024-03-08T21:34:28.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb073e00640 1 -- 172.21.15.119:0/1477289640 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0b47f0 con 0x7fb07c09a8d0 2024-03-08T21:34:28.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb073e00640 1 --2- 172.21.15.119:0/1477289640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c09ad40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0640097c0 tx=0x7fb06401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76458f84488e0b5d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640b0070 con 0x7fb07c09a8d0 2024-03-08T21:34:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0640ab400 con 0x7fb07c09a8d0 2024-03-08T21:34:28.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.013+0000 7fb07aa00640 1 -- 172.21.15.119:0/1477289640 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c001680 con 0x7fb07c09a8d0 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- 172.21.15.119:0/1477289640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 msgr2=0x7fb07c09ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 --2- 172.21.15.119:0/1477289640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c09ad40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb0640097c0 tx=0x7fb06401c3c0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- 172.21.15.119:0/1477289640 shutdown_connections 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 --2- 172.21.15.119:0/1477289640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c09ad40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- 172.21.15.119:0/1477289640 >> 172.21.15.119:0/1477289640 conn(0x7fb07c06c620 msgr2=0x7fb07c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- 172.21.15.119:0/1477289640 shutdown_connections 2024-03-08T21:34:28.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- 172.21.15.119:0/1477289640 wait complete. 2024-03-08T21:34:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 Processor -- start 2024-03-08T21:34:28.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- start start 2024-03-08T21:34:28.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb07c0b1d30 0x7fb07c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1532e0 con 0x7fb07c099ca0 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c153160 con 0x7fb07c09a8d0 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb082200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c153460 con 0x7fb07c0b1d30 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43432/0 (socket says 172.21.15.119:43432) 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 -- 172.21.15.119:0/3976133459 learned_addr learned my addr 172.21.15.119:0/3976133459 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb073e00640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07be00640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb07c0b1d30 0x7fb07c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 -- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb07c0b1d30 msgr2=0x7fb07c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb07c0b1d30 0x7fb07c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 -- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 msgr2=0x7fb07c0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c0b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 -- 172.21.15.119:0/3976133459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c1430b0 con 0x7fb07c099ca0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb073e00640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.017+0000 7fb07b400640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c550 tx=0x7fb06c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c017070 con 0x7fb07c099ca0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c005cf0 con 0x7fb07c099ca0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0072b0 con 0x7fb07c099ca0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0afbe0 con 0x7fb07c099ca0 2024-03-08T21:34:28.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c09bab0 con 0x7fb07c099ca0 2024-03-08T21:34:28.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c067db0 con 0x7fb07c099ca0 2024-03-08T21:34:28.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb06c01a070 con 0x7fb07c099ca0 2024-03-08T21:34:28.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 0x7fb058069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb06c0849e0 con 0x7fb07c099ca0 2024-03-08T21:34:28.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073e00640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 0x7fb058069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.021+0000 7fb073e00640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 0x7fb058069b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0640ad000 tx=0x7fb0640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.025+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb06c0559a0 con 0x7fb07c099ca0 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.181+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb07c0b3920 con 0x7fb07c099ca0 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb073400640 1 -- 172.21.15.119:0/3976133459 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb06c0552a0 con 0x7fb07c099ca0 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout:[ 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout: "poolnum": 1, 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout: "poolname": ".mgr" 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:28.172 INFO:teuthology.orchestra.run.smithi119.stdout:] 2024-03-08T21:34:28.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 msgr2=0x7fb058069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 0x7fb058069b20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb0640ad000 tx=0x7fb0640a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 msgr2=0x7fb07c09b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c550 tx=0x7fb06c00ca10 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 shutdown_connections 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb058067660 0x7fb058069b20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb07c0b1d30 0x7fb07c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb07c09a8d0 0x7fb07c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 --2- 172.21.15.119:0/3976133459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb07c099ca0 0x7fb07c09b450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 >> 172.21.15.119:0/3976133459 conn(0x7fb07c06c620 msgr2=0x7fb07c143560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 shutdown_connections 2024-03-08T21:34:28.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.185+0000 7fb082200640 1 -- 172.21.15.119:0/3976133459 wait complete. 2024-03-08T21:34:28.193 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-08T21:34:28.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-08T21:34:28.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.341+0000 7f1059200640 1 Processor -- start 2024-03-08T21:34:28.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.341+0000 7f1059200640 1 -- start start 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1059200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10540b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1059200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f105414ecb0 0x7f10541510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1059200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105406d5f0 con 0x7f10540b74c0 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1059200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10540b39c0 con 0x7f105414ecb0 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1059200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10540b3ca0 con 0x7f10540b4420 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1051400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f10540b74c0 0x7f10540b7920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54332/0 (socket says 172.21.15.119:54332) 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1051400640 1 -- 172.21.15.119:0/430705559 learned_addr learned my addr 172.21.15.119:0/430705559 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:28.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1051e00640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10540b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1052800640 1 --2- 172.21.15.119:0/430705559 >> v2:172.21.15.160:3300/0 conn(0x7f105414ecb0 0x7f10541510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1050a00640 1 -- 172.21.15.119:0/430705559 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836883496 0 0) 0x7f105406d5f0 con 0x7f10540b74c0 2024-03-08T21:34:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1050a00640 1 -- 172.21.15.119:0/430705559 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1038003530 con 0x7f10540b74c0 2024-03-08T21:34:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1052800640 1 -- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 msgr2=0x7f10540b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:28.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1052800640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10540b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1052800640 1 -- 172.21.15.119:0/430705559 >> v1:172.21.15.119:6789/0 conn(0x7f10540b74c0 legacy=0x7f10540b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.345+0000 7f1052800640 1 -- 172.21.15.119:0/430705559 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105406d890 con 0x7f105414ecb0 2024-03-08T21:34:28.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1052800640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f10541510a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f104c0097c0 tx=0x7f104c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=390b531c48ce598d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1050a00640 1 -- 172.21.15.119:0/430705559 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0b0070 con 0x7f105414ecb0 2024-03-08T21:34:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1050a00640 1 -- 172.21.15.119:0/430705559 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c0ab600 con 0x7f105414ecb0 2024-03-08T21:34:28.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1050a00640 1 -- 172.21.15.119:0/430705559 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0ab9b0 con 0x7f105414ecb0 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 msgr2=0x7f10541510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f10541510a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f104c0097c0 tx=0x7f104c01c410 comp rx=0 tx=0).stop 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- 172.21.15.119:0/430705559 shutdown_connections 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f10541510a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- 172.21.15.119:0/430705559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10540b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- 172.21.15.119:0/430705559 >> 172.21.15.119:0/430705559 conn(0x7f105409a230 msgr2=0x7f105409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- 172.21.15.119:0/430705559 shutdown_connections 2024-03-08T21:34:28.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- 172.21.15.119:0/430705559 wait complete. 2024-03-08T21:34:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 Processor -- start 2024-03-08T21:34:28.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- start start 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10541dfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f105409b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054154190 con 0x7f10540b74c0 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054154010 con 0x7f105414ecb0 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1059200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1054154310 con 0x7f10540b4420 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43440/0 (socket says 172.21.15.119:43440) 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 -- 172.21.15.119:0/242710114 learned_addr learned my addr 172.21.15.119:0/242710114 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051e00640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10541dfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1052800640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f105409b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 -- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 msgr2=0x7f10541dfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10541dfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 -- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 msgr2=0x7f105409b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f105409b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.349+0000 7f1051400640 1 -- 172.21.15.119:0/242710114 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105406fba0 con 0x7f10540b74c0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1052800640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f105409b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1051400640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f104000c420 tx=0x7f104000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040017070 con 0x7f10540b74c0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1040005d10 con 0x7f10540b74c0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10541e02c0 con 0x7f10540b74c0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040007310 con 0x7f10540b74c0 2024-03-08T21:34:28.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105409cc80 con 0x7f10540b74c0 2024-03-08T21:34:28.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1054067db0 con 0x7f10540b74c0 2024-03-08T21:34:28.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f104001a070 con 0x7f10540b74c0 2024-03-08T21:34:28.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 0x7f1034069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:28.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1040084930 con 0x7f10540b74c0 2024-03-08T21:34:28.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.353+0000 7f1051e00640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 0x7f1034069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:28.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.357+0000 7f1051e00640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 0x7f1034069b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10440113e0 tx=0x7f104400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:28.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.361+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f105406fba0 con 0x7f10540b74c0 2024-03-08T21:34:28.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:28.521+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f105414f2a0 con 0x7f10540b74c0 2024-03-08T21:34:29.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.513+0000 7f104a000640 1 -- 172.21.15.119:0/242710114 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1040055360 con 0x7f10540b74c0 2024-03-08T21:34:29.503 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' created 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 msgr2=0x7f1034069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 0x7f1034069b20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10440113e0 tx=0x7f104400b040 comp rx=0 tx=0).stop 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 msgr2=0x7f1054148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f104000c420 tx=0x7f104000c8e0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 shutdown_connections 2024-03-08T21:34:29.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1034067660 0x7f1034069b20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f105414ecb0 0x7f105409b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10540b74c0 0x7f1054148030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 --2- 172.21.15.119:0/242710114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10540b4420 0x7f10541dfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.517+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 >> 172.21.15.119:0/242710114 conn(0x7f105409a230 msgr2=0x7f105414faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:29.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.521+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 shutdown_connections 2024-03-08T21:34:29.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.521+0000 7f1059200640 1 -- 172.21.15.119:0/242710114 wait complete. 2024-03-08T21:34:29.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-08T21:34:29.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 Processor -- start 2024-03-08T21:34:29.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 -- start start 2024-03-08T21:34:29.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4040b4b80 0x7fd404143c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40409b680 con 0x7fd4040b3fc0 2024-03-08T21:34:29.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40409e5c0 con 0x7fd4041441a0 2024-03-08T21:34:29.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40c600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040adef0 con 0x7fd4040b4b80 2024-03-08T21:34:29.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409c00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd4040b3fc0 0x7fd40409deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54338/0 (socket says 172.21.15.119:54338) 2024-03-08T21:34:29.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409c00640 1 -- 172.21.15.119:0/483283117 learned_addr learned my addr 172.21.15.119:0/483283117 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:29.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 --2- 172.21.15.119:0/483283117 >> v2:172.21.15.160:3300/0 conn(0x7fd4040b4b80 0x7fd404143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123666338 0 0) 0x7fd40409b680 con 0x7fd4040b3fc0 2024-03-08T21:34:29.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003530 con 0x7fd4040b3fc0 2024-03-08T21:34:29.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277894630 0 0) 0x7fd3ec003530 con 0x7fd4040b3fc0 2024-03-08T21:34:29.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 >> v2:172.21.15.160:3300/0 conn(0x7fd4040b4b80 msgr2=0x7fd404143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 --2- 172.21.15.119:0/483283117 >> v2:172.21.15.160:3300/0 conn(0x7fd4040b4b80 0x7fd404143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 >> v1:172.21.15.160:6789/0 conn(0x7fd4041441a0 legacy=0x7fd40414e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040ae1d0 con 0x7fd4040b3fc0 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fd3f8001680 con 0x7fd4040b3fc0 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 >> v1:172.21.15.119:6789/0 conn(0x7fd4040b3fc0 legacy=0x7fd40409deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3ec0039c0 0x7fd3ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd3ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3ec0052f0 0x7fd3ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040adef0 con 0x7fd3ec0052f0 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec00c1c0 con 0x7fd3ec004810 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec00c3c0 con 0x7fd3ec0039c0 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40a600640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3ec0052f0 0x7fd3ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd3ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409c00640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3ec0039c0 0x7fd3ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 -- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3ec0039c0 msgr2=0x7fd3ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3ec0039c0 0x7fd3ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 -- 172.21.15.119:0/483283117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3ec0052f0 msgr2=0x7fd3ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3ec0052f0 0x7fd3ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd409200640 1 -- 172.21.15.119:0/483283117 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec003530 con 0x7fd3ec004810 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40a600640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3ec0052f0 0x7fd3ec00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.693+0000 7fd40a600640 1 -- 172.21.15.119:0/483283117 reap_dead start 2024-03-08T21:34:29.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd409200640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd3ec004c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4040b4f80 tx=0x7fd3f001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e258d1b160fdea79 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:29.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00b2070 con 0x7fd3ec004810 2024-03-08T21:34:29.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00a5580 con 0x7fd3ec004810 2024-03-08T21:34:29.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd403e00640 1 -- 172.21.15.119:0/483283117 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00096b0 con 0x7fd3ec004810 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 -- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 msgr2=0x7fd3ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd3ec004c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4040b4f80 tx=0x7fd3f001ca10 comp rx=0 tx=0).stop 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 -- 172.21.15.119:0/483283117 shutdown_connections 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 --2- 172.21.15.119:0/483283117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd3ec004c90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 -- 172.21.15.119:0/483283117 >> 172.21.15.119:0/483283117 conn(0x7fd4040b4fb0 msgr2=0x7fd4040b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 -- 172.21.15.119:0/483283117 shutdown_connections 2024-03-08T21:34:29.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.697+0000 7fd40c600640 1 -- 172.21.15.119:0/483283117 wait complete. 2024-03-08T21:34:29.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 Processor -- start 2024-03-08T21:34:29.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- start start 2024-03-08T21:34:29.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd4041e0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4040b02e0 0x7fd4041465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40409deb0 con 0x7fd40413d260 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404073320 con 0x7fd3ec004810 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40409e030 con 0x7fd4040b02e0 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43450/0 (socket says 172.21.15.119:43450) 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 -- 172.21.15.119:0/92272410 learned_addr learned my addr 172.21.15.119:0/92272410 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd409c00640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd4041e0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd409200640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4040b02e0 0x7fd4041465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 -- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4040b02e0 msgr2=0x7fd4041465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4040b02e0 0x7fd4041465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 -- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 msgr2=0x7fd4041e0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:29.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd4041e0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 -- 172.21.15.119:0/92272410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404070890 con 0x7fd40413d260 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd409c00640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd4041e0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40a600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4040af4e0 tx=0x7fd3fc001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc01a070 con 0x7fd40413d260 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc006d70 con 0x7fd40413d260 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc001a90 con 0x7fd40413d260 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040b0720 con 0x7fd40413d260 2024-03-08T21:34:29.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.701+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4040afae0 con 0x7fd40413d260 2024-03-08T21:34:29.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd404067db0 con 0x7fd40413d260 2024-03-08T21:34:29.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd3fc003bc0 con 0x7fd40413d260 2024-03-08T21:34:29.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd401600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 0x7fd3e4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:29.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd3fc0851e0 con 0x7fd40413d260 2024-03-08T21:34:29.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd409c00640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 0x7fd3e4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:29.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.705+0000 7fd409c00640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 0x7fd3e4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007d60 tx=0x7fd3f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:29.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.709+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd3fc023020 con 0x7fd40413d260 2024-03-08T21:34:29.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:29.861+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd40409bc00 con 0x7fd40413d260 2024-03-08T21:34:30.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.521+0000 7fd401600640 1 -- 172.21.15.119:0/92272410 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v28) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd3fc055a60 con 0x7fd40413d260 2024-03-08T21:34:30.511 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' created 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 msgr2=0x7fd3e4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 0x7fd3e4069b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007d60 tx=0x7fd3f8009040 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 msgr2=0x7fd40413d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4040af4e0 tx=0x7fd3fc001a10 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 shutdown_connections 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd3e4067660 0x7fd3e4069b20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd40413d260 0x7fd40413d710 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4040b02e0 0x7fd4041465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 --2- 172.21.15.119:0/92272410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3ec004810 0x7fd4041e0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 >> 172.21.15.119:0/92272410 conn(0x7fd4040b4fb0 msgr2=0x7fd40409c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 shutdown_connections 2024-03-08T21:34:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.525+0000 7fd40c600640 1 -- 172.21.15.119:0/92272410 wait complete. 2024-03-08T21:34:30.551 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-08T21:34:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 Processor -- start 2024-03-08T21:34:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 -- start start 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd580066ad0 0x7fd5800af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58013f1c0 con 0x7fd580066eb0 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5801485c0 con 0x7fd5801480a0 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd584a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800aebd0 con 0x7fd580066ad0 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd580066ad0 0x7fd5800af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd580066ad0 0x7fd5800af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43456/0 (socket says 172.21.15.119:43456) 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 -- 172.21.15.119:0/998220697 learned_addr learned my addr 172.21.15.119:0/998220697 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57fe00640 1 --1- 172.21.15.119:0/998220697 >> v1:172.21.15.119:6789/0 conn(0x7fd580066eb0 0x7fd580144ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54340/0 (socket says 172.21.15.119:54340) 2024-03-08T21:34:30.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 -- 172.21.15.119:0/998220697 >> v1:172.21.15.160:6789/0 conn(0x7fd5801480a0 legacy=0x7fd58013eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 -- 172.21.15.119:0/998220697 >> v1:172.21.15.119:6789/0 conn(0x7fd580066eb0 legacy=0x7fd580144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.701+0000 7fd57f400640 1 -- 172.21.15.119:0/998220697 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5801488a0 con 0x7fd580066ad0 2024-03-08T21:34:30.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd57f400640 1 --2- 172.21.15.119:0/998220697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5800af890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd57001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81414d3bc79ef6a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:30.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd57ea00640 1 -- 172.21.15.119:0/998220697 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700b1070 con 0x7fd580066ad0 2024-03-08T21:34:30.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd57ea00640 1 -- 172.21.15.119:0/998220697 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5700a8050 con 0x7fd580066ad0 2024-03-08T21:34:30.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd57ea00640 1 -- 172.21.15.119:0/998220697 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700ac860 con 0x7fd580066ad0 2024-03-08T21:34:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- 172.21.15.119:0/998220697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 msgr2=0x7fd5800af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 --2- 172.21.15.119:0/998220697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5800af890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd57001c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- 172.21.15.119:0/998220697 shutdown_connections 2024-03-08T21:34:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 --2- 172.21.15.119:0/998220697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5800af890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- 172.21.15.119:0/998220697 >> 172.21.15.119:0/998220697 conn(0x7fd58006ccd0 msgr2=0x7fd58006d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- 172.21.15.119:0/998220697 shutdown_connections 2024-03-08T21:34:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- 172.21.15.119:0/998220697 wait complete. 2024-03-08T21:34:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 Processor -- start 2024-03-08T21:34:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- start start 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd580066eb0 0x7fd580137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5801480a0 0x7fd580138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580152ff0 con 0x7fd580066ad0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580152e70 con 0x7fd5801480a0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.705+0000 7fd584a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580153170 con 0x7fd580066eb0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43458/0 (socket says 172.21.15.119:43458) 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 -- 172.21.15.119:0/2339035721 learned_addr learned my addr 172.21.15.119:0/2339035721 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57fe00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5801480a0 0x7fd580138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd576a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd580066eb0 0x7fd580137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 -- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd580066eb0 msgr2=0x7fd580137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd580066eb0 0x7fd580137e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 -- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5801480a0 msgr2=0x7fd580138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5801480a0 0x7fd580138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 -- 172.21.15.119:0/2339035721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5801e0040 con 0x7fd580066ad0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd57f400640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd57001a100 tx=0x7fd57001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700bc070 con 0x7fd580066ad0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5700b7630 con 0x7fd580066ad0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700b1040 con 0x7fd580066ad0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5801e0320 con 0x7fd580066ad0 2024-03-08T21:34:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd580145c70 con 0x7fd580066ad0 2024-03-08T21:34:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd580067db0 con 0x7fd580066ad0 2024-03-08T21:34:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd5700ab3e0 con 0x7fd580066ad0 2024-03-08T21:34:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.709+0000 7fd577e00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 0x7fd55c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.713+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd57011f390 con 0x7fd580066ad0 2024-03-08T21:34:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.713+0000 7fd576a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 0x7fd55c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.713+0000 7fd576a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 0x7fd55c069b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd58013ac70 tx=0x7fd568009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:30.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.717+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd570016150 con 0x7fd580066ad0 2024-03-08T21:34:30.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:30.905+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5800b7c70 con 0x7fd580066ad0 2024-03-08T21:34:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.525+0000 7fd577e00640 1 -- 172.21.15.119:0/2339035721 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd5700f0060 con 0x7fd580066ad0 2024-03-08T21:34:31.513 INFO:teuthology.orchestra.run.smithi119.stderr:new fs with metadata pool 4 and data pool 5 2024-03-08T21:34:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.529+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 msgr2=0x7fd55c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.529+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 0x7fd55c069b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd58013ac70 tx=0x7fd568009040 comp rx=0 tx=0).stop 2024-03-08T21:34:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.529+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 msgr2=0x7fd5801442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.529+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd57001a100 tx=0x7fd57001ad10 comp rx=0 tx=0).stop 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 shutdown_connections 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd55c067660 0x7fd55c069b20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5801480a0 0x7fd580138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd580066eb0 0x7fd580137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 --2- 172.21.15.119:0/2339035721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd580066ad0 0x7fd5801442a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.533+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 >> 172.21.15.119:0/2339035721 conn(0x7fd58006ccd0 msgr2=0x7fd5800b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:31.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.537+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 shutdown_connections 2024-03-08T21:34:31.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.537+0000 7fd584a00640 1 -- 172.21.15.119:0/2339035721 wait complete. 2024-03-08T21:34:31.572 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:31.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.717+0000 7f2cf3e00640 1 Processor -- start 2024-03-08T21:34:31.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.717+0000 7f2cf3e00640 1 -- start start 2024-03-08T21:34:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec09adb0 0x7f2cec09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf3e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2cec072fe0 0x7f2cec1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf3e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec09b190 con 0x7f2cec1446e0 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf3e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec09d240 con 0x7f2cec072fe0 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec09d520 con 0x7f2cec09adb0 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2cec072fe0 0x7f2cec1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec09adb0 0x7f2cec09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2cec072fe0 0x7f2cec1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:51540/0 (socket says 172.21.15.119:51540) 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 -- 172.21.15.119:0/2243075382 learned_addr learned my addr 172.21.15.119:0/2243075382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 -- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec09adb0 msgr2=0x7f2cec09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:31.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 --2- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec09adb0 0x7f2cec09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 -- 172.21.15.119:0/2243075382 >> v1:172.21.15.160:6789/0 conn(0x7f2cec1446e0 legacy=0x7f2cec13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.721+0000 7f2cf0a00640 1 -- 172.21.15.119:0/2243075382 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec144af0 con 0x7f2cec072fe0 2024-03-08T21:34:31.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf0a00640 1 --2- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec072fe0 0x7f2cec1441a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009870 tx=0x7f2cd801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=992857f66aaef966 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:31.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cebe00640 1 -- 172.21.15.119:0/2243075382 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80aa680 con 0x7f2cec072fe0 2024-03-08T21:34:31.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cebe00640 1 -- 172.21.15.119:0/2243075382 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd80af070 con 0x7f2cec072fe0 2024-03-08T21:34:31.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cebe00640 1 -- 172.21.15.119:0/2243075382 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80aaa40 con 0x7f2cec072fe0 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec072fe0 msgr2=0x7f2cec1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec072fe0 0x7f2cec1441a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009870 tx=0x7f2cd801c500 comp rx=0 tx=0).stop 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- 172.21.15.119:0/2243075382 shutdown_connections 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec072fe0 0x7f2cec1441a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/2243075382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec09adb0 0x7f2cec09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- 172.21.15.119:0/2243075382 >> 172.21.15.119:0/2243075382 conn(0x7f2cec06c620 msgr2=0x7f2cec06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- 172.21.15.119:0/2243075382 shutdown_connections 2024-03-08T21:34:31.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- 172.21.15.119:0/2243075382 wait complete. 2024-03-08T21:34:31.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 Processor -- start 2024-03-08T21:34:31.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- start start 2024-03-08T21:34:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec072fe0 0x7f2cec1381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec09adb0 0x7f2cec0b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec151180 con 0x7f2cec1446e0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec151000 con 0x7f2cec09adb0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf3e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec151300 con 0x7f2cec072fe0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec072fe0 0x7f2cec1381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43466/0 (socket says 172.21.15.119:43466) 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.725+0000 7f2cf1e00640 1 -- 172.21.15.119:0/360356384 learned_addr learned my addr 172.21.15.119:0/360356384 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf0a00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec09adb0 0x7f2cec0b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 -- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec072fe0 msgr2=0x7f2cec1381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec072fe0 0x7f2cec1381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 -- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec09adb0 msgr2=0x7f2cec0b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec09adb0 0x7f2cec0b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 -- 172.21.15.119:0/360356384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0b6470 con 0x7f2cec1446e0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf1e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c730 tx=0x7f2ce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:31.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4003b80 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4003d20 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4005310 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec0b6750 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec0b6f50 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec067db0 con 0x7f2cec1446e0 2024-03-08T21:34:31.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2ce40056c0 con 0x7f2cec1446e0 2024-03-08T21:34:31.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 0x7f2ccc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:31.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.729+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ce40857c0 con 0x7f2cec1446e0 2024-03-08T21:34:31.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.733+0000 7f2cf1400640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 0x7f2ccc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:31.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.733+0000 7f2cf1400640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 0x7f2ccc069b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009b60 tx=0x7f2ce0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:31.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.737+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2ce4055de0 con 0x7f2cec1446e0 2024-03-08T21:34:31.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.889+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cec0b3960 con 0x7f2cec1446e0 2024-03-08T21:34:31.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2ce9600640 1 -- 172.21.15.119:0/360356384 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f2ce4059e80 con 0x7f2cec1446e0 2024-03-08T21:34:31.880 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:31.880 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":29,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:30.907765+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 msgr2=0x7f2ccc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 0x7f2ccc069b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009b60 tx=0x7f2ce0009190 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 msgr2=0x7f2cec0aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400c730 tx=0x7f2ce400cbf0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 shutdown_connections 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2ccc067660 0x7f2ccc069b20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cec1446e0 0x7f2cec0aed80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec09adb0 0x7f2cec0b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 --2- 172.21.15.119:0/360356384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec072fe0 0x7f2cec1381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 >> 172.21.15.119:0/360356384 conn(0x7f2cec06c620 msgr2=0x7f2cec06ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:31.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 shutdown_connections 2024-03-08T21:34:31.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:31.893+0000 7f2cf3e00640 1 -- 172.21.15.119:0/360356384 wait complete. 2024-03-08T21:34:31.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:32.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 Processor -- start 2024-03-08T21:34:32.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 -- start start 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 0x7fc74c13ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc74c13f2c0 0x7fc74c09a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c09a080 con 0x7fc74c09ae10 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0b4b60 con 0x7fc74c13f2c0 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc754400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0b4510 con 0x7fc74c099ca0 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc751000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc74c13f2c0 0x7fc74c09a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc752400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc74c09ae10 0x7fc74c0b1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:54356/0 (socket says 172.21.15.119:54356) 2024-03-08T21:34:32.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.045+0000 7fc752400640 1 -- 172.21.15.119:0/1544057201 learned_addr learned my addr 172.21.15.119:0/1544057201 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:32.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751a00640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 0x7fc74c13ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751000640 1 -- 172.21.15.119:0/1544057201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 msgr2=0x7fc74c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:32.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751000640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 0x7fc74c13ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751000640 1 -- 172.21.15.119:0/1544057201 >> v1:172.21.15.119:6789/0 conn(0x7fc74c09ae10 legacy=0x7fc74c0b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751000640 1 -- 172.21.15.119:0/1544057201 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0b47f0 con 0x7fc74c13f2c0 2024-03-08T21:34:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751a00640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 0x7fc74c13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc74be00640 1 -- 172.21.15.119:0/1544057201 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902978123 0 0) 0x7fc74c09a080 con 0x7fc74c09ae10 2024-03-08T21:34:32.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc751000640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c13f2c0 0x7fc74c09a8d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc7380097c0 tx=0x7fc73801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a39f0b39b0f1e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc74be00640 1 -- 172.21.15.119:0/1544057201 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380b1070 con 0x7fc74c13f2c0 2024-03-08T21:34:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc74be00640 1 -- 172.21.15.119:0/1544057201 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7380ac410 con 0x7fc74c13f2c0 2024-03-08T21:34:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc74be00640 1 -- 172.21.15.119:0/1544057201 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7380ac7e0 con 0x7fc74c13f2c0 2024-03-08T21:34:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 -- 172.21.15.119:0/1544057201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c13f2c0 msgr2=0x7fc74c09a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c13f2c0 0x7fc74c09a8d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc7380097c0 tx=0x7fc73801c460 comp rx=0 tx=0).stop 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 -- 172.21.15.119:0/1544057201 shutdown_connections 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c13f2c0 0x7fc74c09a8d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 --2- 172.21.15.119:0/1544057201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c099ca0 0x7fc74c13ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 -- 172.21.15.119:0/1544057201 >> 172.21.15.119:0/1544057201 conn(0x7fc74c06c620 msgr2=0x7fc74c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 -- 172.21.15.119:0/1544057201 shutdown_connections 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.049+0000 7fc754400640 1 -- 172.21.15.119:0/1544057201 wait complete. 2024-03-08T21:34:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 Processor -- start 2024-03-08T21:34:32.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- start start 2024-03-08T21:34:32.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c09ae10 0x7fc74c1e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c13f2c0 0x7fc74c136620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c1522d0 con 0x7fc74c099ca0 2024-03-08T21:34:32.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c152150 con 0x7fc74c09ae10 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c152450 con 0x7fc74c13f2c0 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43486/0 (socket says 172.21.15.119:43486) 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 -- 172.21.15.119:0/1202438220 learned_addr learned my addr 172.21.15.119:0/1202438220 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc752400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c13f2c0 0x7fc74c136620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751000640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c09ae10 0x7fc74c1e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 -- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c13f2c0 msgr2=0x7fc74c136620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c13f2c0 0x7fc74c136620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 -- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c09ae10 msgr2=0x7fc74c1e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c09ae10 0x7fc74c1e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 -- 172.21.15.119:0/1202438220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0704a0 con 0x7fc74c099ca0 2024-03-08T21:34:32.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc751a00640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c7f0 tx=0x7fc74000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740015070 con 0x7fc74c099ca0 2024-03-08T21:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740007820 con 0x7fc74c099ca0 2024-03-08T21:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c071f50 con 0x7fc74c099ca0 2024-03-08T21:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740007c10 con 0x7fc74c099ca0 2024-03-08T21:34:32.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.053+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c070a20 con 0x7fc74c099ca0 2024-03-08T21:34:32.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c09c520 con 0x7fc74c099ca0 2024-03-08T21:34:32.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc740018070 con 0x7fc74c099ca0 2024-03-08T21:34:32.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc749600640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 0x7fc72c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc740085800 con 0x7fc74c099ca0 2024-03-08T21:34:32.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc751000640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 0x7fc72c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.057+0000 7fc751000640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 0x7fc72c069b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ae000 tx=0x7fc7380a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.061+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fc740055ec0 con 0x7fc74c099ca0 2024-03-08T21:34:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.217+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc74c067db0 con 0x7fc74c099ca0 2024-03-08T21:34:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.217+0000 7fc749600640 1 -- 172.21.15.119:0/1202438220 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16706 (secure 0 0 0) 0x7fc740059f60 con 0x7fc74c099ca0 2024-03-08T21:34:32.207 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:32.207 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":29,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:30.907765+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 msgr2=0x7fc72c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 0x7fc72c069b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ae000 tx=0x7fc7380a6040 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 msgr2=0x7fc74c0b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c7f0 tx=0x7fc74000ccb0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 shutdown_connections 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc72c067690 0x7fc72c069b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc74c13f2c0 0x7fc74c136620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc74c09ae10 0x7fc74c1e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 --2- 172.21.15.119:0/1202438220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc74c099ca0 0x7fc74c0b7a30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 >> 172.21.15.119:0/1202438220 conn(0x7fc74c06c620 msgr2=0x7fc74c13d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 shutdown_connections 2024-03-08T21:34:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.221+0000 7fc754400640 1 -- 172.21.15.119:0/1202438220 wait complete. 2024-03-08T21:34:32.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-08T21:34:32.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 Processor -- start 2024-03-08T21:34:32.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 -- start start 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c94072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0c9406eaf0 0x7f0c94147170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c94071e50 con 0x7f0c9406b6f0 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c941476b0 con 0x7f0c9406eaf0 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c9a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9406aef0 con 0x7f0c940728b0 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0c9406eaf0 0x7f0c94147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0c9406eaf0 0x7f0c94147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43500/0 (socket says 172.21.15.119:43500) 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 -- 172.21.15.119:0/2719191041 learned_addr learned my addr 172.21.15.119:0/2719191041 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c93400640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c94072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 -- 172.21.15.119:0/2719191041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 msgr2=0x7f0c94072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c94072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 -- 172.21.15.119:0/2719191041 >> v1:172.21.15.160:6789/0 conn(0x7f0c9406b6f0 legacy=0x7f0c940b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c8aa00640 1 -- 172.21.15.119:0/2719191041 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9406b1d0 con 0x7f0c9406eaf0 2024-03-08T21:34:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.377+0000 7f0c93400640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c94072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c8aa00640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406eaf0 0x7f0c94147170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca1e007bc705057 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c92a00640 1 -- 172.21.15.119:0/2719191041 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b1070 con 0x7f0c9406eaf0 2024-03-08T21:34:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c92a00640 1 -- 172.21.15.119:0/2719191041 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0a8050 con 0x7f0c9406eaf0 2024-03-08T21:34:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c92a00640 1 -- 172.21.15.119:0/2719191041 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0ac860 con 0x7f0c9406eaf0 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- 172.21.15.119:0/2719191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406eaf0 msgr2=0x7f0c94147170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406eaf0 0x7f0c94147170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c01c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- 172.21.15.119:0/2719191041 shutdown_connections 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406eaf0 0x7f0c94147170 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 --2- 172.21.15.119:0/2719191041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c94072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- 172.21.15.119:0/2719191041 >> 172.21.15.119:0/2719191041 conn(0x7f0c940b6130 msgr2=0x7f0c940b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- 172.21.15.119:0/2719191041 shutdown_connections 2024-03-08T21:34:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- 172.21.15.119:0/2719191041 wait complete. 2024-03-08T21:34:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 Processor -- start 2024-03-08T21:34:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.381+0000 7f0c9a800640 1 -- start start 2024-03-08T21:34:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c9406eaf0 0x7f0c941e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c940992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941545c0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94154440 con 0x7f0c9406eaf0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94154740 con 0x7f0c940728b0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:43502/0 (socket says 172.21.15.119:43502) 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 -- 172.21.15.119:0/1971351364 learned_addr learned my addr 172.21.15.119:0/1971351364 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c8aa00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c9406eaf0 0x7f0c941e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93e00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c940992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 -- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 msgr2=0x7f0c940992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c940992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 -- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c9406eaf0 msgr2=0x7f0c941e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c9406eaf0 0x7f0c941e2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 -- 172.21.15.119:0/1971351364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9409be10 con 0x7f0c9406b6f0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93e00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c940992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c93400640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400e810 tx=0x7f0c8400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84017070 con 0x7f0c9406b6f0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400c8d0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9409d880 con 0x7f0c9406b6f0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400f040 con 0x7f0c9406b6f0 2024-03-08T21:34:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9409c0d0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94067db0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.385+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0c8401a070 con 0x7f0c9406b6f0 2024-03-08T21:34:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.389+0000 7f0c8be00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 0x7f0c70069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.389+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c840853b0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.389+0000 7f0c8aa00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 0x7f0c70069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.389+0000 7f0c8aa00640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 0x7f0c70069b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0ae000 tx=0x7f0c7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.393+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f0c840559d0 con 0x7f0c9406b6f0 2024-03-08T21:34:32.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:32.585+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0c9409f710 con 0x7f0c9406b6f0 2024-03-08T21:34:33.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c8be00640 1 -- 172.21.15.119:0/1971351364 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c84059a70 con 0x7f0c9406b6f0 2024-03-08T21:34:33.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 msgr2=0x7f0c70069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 0x7f0c70069b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0ae000 tx=0x7f0c7c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:33.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 msgr2=0x7f0c940b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400e810 tx=0x7f0c8400ecd0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 shutdown_connections 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0c70067690 0x7f0c70069b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c940728b0 0x7f0c940992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c9406eaf0 0x7f0c941e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 --2- 172.21.15.119:0/1971351364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c9406b6f0 0x7f0c940b2da0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 >> 172.21.15.119:0/1971351364 conn(0x7f0c940b6130 msgr2=0x7f0c940b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 shutdown_connections 2024-03-08T21:34:33.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.557+0000 7f0c9a800640 1 -- 172.21.15.119:0/1971351364 wait complete. 2024-03-08T21:34:33.570 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-08T21:34:33.570 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-08T21:34:33.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 Processor -- start 2024-03-08T21:34:33.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 -- start start 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f747006c840 0x7f74700b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 0x7f74701413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747006cc20 con 0x7f7470144030 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74700b3670 con 0x7f747006c840 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f7476000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700b3950 con 0x7f7470140fb0 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f747006c840 0x7f74700b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746ea00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7470144030 0x7f74701444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46530/0 (socket says 172.21.15.119:46530) 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746ea00640 1 -- 172.21.15.119:0/2261040645 learned_addr learned my addr 172.21.15.119:0/2261040645 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746fe00640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 0x7f74701413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746f400640 1 -- 172.21.15.119:0/2261040645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 msgr2=0x7f74701413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746f400640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 0x7f74701413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746f400640 1 -- 172.21.15.119:0/2261040645 >> v1:172.21.15.119:6789/0 conn(0x7f7470144030 legacy=0x7f74701444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746f400640 1 -- 172.21.15.119:0/2261040645 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470141920 con 0x7f747006c840 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746e000640 1 -- 172.21.15.119:0/2261040645 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387866291 0 0) 0x7f747006cc20 con 0x7f7470144030 2024-03-08T21:34:33.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.725+0000 7f746fe00640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 0x7f74701413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:33.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f746f400640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b3090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f74600097c0 tx=0x7f746001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2121a063c90a3d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:33.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f746e000640 1 -- 172.21.15.119:0/2261040645 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600b0070 con 0x7f747006c840 2024-03-08T21:34:33.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f746e000640 1 -- 172.21.15.119:0/2261040645 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74600ab600 con 0x7f747006c840 2024-03-08T21:34:33.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f746e000640 1 -- 172.21.15.119:0/2261040645 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600ab9d0 con 0x7f747006c840 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 -- 172.21.15.119:0/2261040645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 msgr2=0x7f74700b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b3090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f74600097c0 tx=0x7f746001c410 comp rx=0 tx=0).stop 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 -- 172.21.15.119:0/2261040645 shutdown_connections 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470140fb0 0x7f74701413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 --2- 172.21.15.119:0/2261040645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b3090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 -- 172.21.15.119:0/2261040645 >> 172.21.15.119:0/2261040645 conn(0x7f747009a230 msgr2=0x7f747009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:33.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 -- 172.21.15.119:0/2261040645 shutdown_connections 2024-03-08T21:34:33.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 -- 172.21.15.119:0/2261040645 wait complete. 2024-03-08T21:34:33.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.729+0000 7f7476000640 1 Processor -- start 2024-03-08T21:34:33.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- start start 2024-03-08T21:34:33.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7470140fb0 0x7f7470146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 0x7f7470146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470150de0 con 0x7f747006c840 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747006e190 con 0x7f7470140fb0 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7470150f60 con 0x7f7470144030 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52386/0 (socket says 172.21.15.119:52386) 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 -- 172.21.15.119:0/2971921016 learned_addr learned my addr 172.21.15.119:0/2971921016 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746ea00640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7470140fb0 0x7f7470146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746fe00640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 0x7f7470146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 -- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 msgr2=0x7f7470146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 0x7f7470146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 -- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7470140fb0 msgr2=0x7f7470146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7470140fb0 0x7f7470146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 -- 172.21.15.119:0/2971921016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470147760 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746fe00640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 0x7f7470146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f746f400640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74600ae040 tx=0x7f74600191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600b8020 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74600b4630 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74600b0040 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470148090 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74701466c0 con 0x7f747006c840 2024-03-08T21:34:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.733+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7470067db0 con 0x7f747006c840 2024-03-08T21:34:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.737+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f74600bb020 con 0x7f747006c840 2024-03-08T21:34:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.737+0000 7f7467400640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 0x7f7450069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.737+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f746011f430 con 0x7f747006c840 2024-03-08T21:34:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.737+0000 7f746ea00640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 0x7f7450069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.737+0000 7f746ea00640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 0x7f7450069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f74700b68c0 tx=0x7f745c007d60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.741+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f74600c2030 con 0x7f747006c840 2024-03-08T21:34:33.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:33.929+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74700b8260 con 0x7f747006c840 2024-03-08T21:34:34.478 INFO:tasks.ceph.mds.a.smithi119.stderr:2024-03-08T21:34:34.489+0000 7f8efec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T21:34:34.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.561+0000 7f7467400640 1 -- 172.21.15.119:0/2971921016 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7460016090 con 0x7f747006c840 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 msgr2=0x7f7450069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 0x7f7450069b20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f74700b68c0 tx=0x7f745c007d60 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 msgr2=0x7f74700b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74600ae040 tx=0x7f74600191b0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 shutdown_connections 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7450067660 0x7f7450069b20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7470144030 0x7f7470146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7470140fb0 0x7f7470146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 --2- 172.21.15.119:0/2971921016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f747006c840 0x7f74700b1eb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 >> 172.21.15.119:0/2971921016 conn(0x7f747009a230 msgr2=0x7f747006ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 shutdown_connections 2024-03-08T21:34:34.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.565+0000 7f7476000640 1 -- 172.21.15.119:0/2971921016 wait complete. 2024-03-08T21:34:34.575 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-08T21:34:34.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:34.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.721+0000 7fc116e00640 1 Processor -- start 2024-03-08T21:34:34.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.721+0000 7fc116e00640 1 -- start start 2024-03-08T21:34:34.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.721+0000 7fc116e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc11006e060 0x7fc110066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.721+0000 7fc116e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc116e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11013f370 con 0x7fc110071df0 2024-03-08T21:34:34.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc116e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc110070560 con 0x7fc11006e060 2024-03-08T21:34:34.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc116e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11006e440 con 0x7fc11013e9a0 2024-03-08T21:34:34.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc114e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc11006e060 0x7fc110066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc11006e060 0x7fc110066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:60980/0 (socket says 172.21.15.119:60980) 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 -- 172.21.15.119:0/3966800365 learned_addr learned my addr 172.21.15.119:0/3966800365 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc114e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:34490/0 (socket says 172.21.15.119:34490) 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10f400640 1 --1- 172.21.15.119:0/3966800365 >> v1:172.21.15.160:6789/0 conn(0x7fc110071df0 0x7fc110072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:55788/0 (socket says 172.21.15.119:55788) 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 -- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 msgr2=0x7fc11013ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 -- 172.21.15.119:0/3966800365 >> v1:172.21.15.160:6789/0 conn(0x7fc110071df0 legacy=0x7fc110072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 -- 172.21.15.119:0/3966800365 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100701f0 con 0x7fc11006e060 2024-03-08T21:34:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc114e00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.725+0000 7fc10fe00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11006e060 0x7fc110066ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc100009870 tx=0x7fc10001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e99e8ac1a8de868 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:34.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10ea00640 1 -- 172.21.15.119:0/3966800365 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000aa650 con 0x7fc11006e060 2024-03-08T21:34:34.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10ea00640 1 -- 172.21.15.119:0/3966800365 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000af070 con 0x7fc11006e060 2024-03-08T21:34:34.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10ea00640 1 -- 172.21.15.119:0/3966800365 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000aaa10 con 0x7fc11006e060 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11006e060 msgr2=0x7fc110066ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11006e060 0x7fc110066ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc100009870 tx=0x7fc10001c4d0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- 172.21.15.119:0/3966800365 shutdown_connections 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc11013e9a0 0x7fc11013ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- 172.21.15.119:0/3966800365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11006e060 0x7fc110066ad0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- 172.21.15.119:0/3966800365 >> 172.21.15.119:0/3966800365 conn(0x7fc1100b5870 msgr2=0x7fc1100b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- 172.21.15.119:0/3966800365 shutdown_connections 2024-03-08T21:34:34.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- 172.21.15.119:0/3966800365 wait complete. 2024-03-08T21:34:34.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 Processor -- start 2024-03-08T21:34:34.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- start start 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 0x7fc110145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11013e9a0 0x7fc110139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110152010 con 0x7fc11006e060 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100b4f80 con 0x7fc11013e9a0 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc116e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc110152190 con 0x7fc110071df0 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52388/0 (socket says 172.21.15.119:52388) 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10fe00640 1 -- 172.21.15.119:0/1839919150 learned_addr learned my addr 172.21.15.119:0/1839919150 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc114e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11013e9a0 0x7fc110139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.729+0000 7fc10f400640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 0x7fc110145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 -- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 msgr2=0x7fc110145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 0x7fc110145590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 -- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11013e9a0 msgr2=0x7fc110139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11013e9a0 0x7fc110139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 -- 172.21.15.119:0/1839919150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110144e90 con 0x7fc11006e060 2024-03-08T21:34:34.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10f400640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 0x7fc110145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:34.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10fe00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc1000ac040 tx=0x7fc10001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000bd5f0 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000a6040 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000bd9f0 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11013aab0 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc110142ad0 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110142d60 con 0x7fc11006e060 2024-03-08T21:34:34.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc1000c6440 con 0x7fc11006e060 2024-03-08T21:34:34.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 0x7fc0f0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:34.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc10011fe90 con 0x7fc11006e060 2024-03-08T21:34:34.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.733+0000 7fc10f400640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 0x7fc0f0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:34.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.737+0000 7fc10f400640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 0x7fc0f0069b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc11013a910 tx=0x7fc0fc007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.737+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fc100016150 con 0x7fc11006e060 2024-03-08T21:34:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc110067db0 con 0x7fc11006e060 2024-03-08T21:34:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc107e00640 1 -- 172.21.15.119:0/1839919150 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7fc1000f0c20 con 0x7fc11006e060 2024-03-08T21:34:34.913 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:34.914 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:34.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 msgr2=0x7fc0f0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 0x7fc0f0069b20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc11013a910 tx=0x7fc0fc007d70 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 msgr2=0x7fc1100af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc1000ac040 tx=0x7fc10001ad10 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 shutdown_connections 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc0f0067660 0x7fc0f0069b20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc11013e9a0 0x7fc110139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc110071df0 0x7fc110145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 --2- 172.21.15.119:0/1839919150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc11006e060 0x7fc1100af290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 >> 172.21.15.119:0/1839919150 conn(0x7fc1100b5870 msgr2=0x7fc11013c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.925+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 shutdown_connections 2024-03-08T21:34:34.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:34.929+0000 7fc116e00640 1 -- 172.21.15.119:0/1839919150 wait complete. 2024-03-08T21:34:34.934 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:35.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 Processor -- start 2024-03-08T21:34:35.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 -- start start 2024-03-08T21:34:35.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 0x7fe19809ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe1980b1d30 0x7fe1980b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980b26c0 con 0x7fe198099ca0 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980b4b60 con 0x7fe1980b1d30 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19f800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19809a080 con 0x7fe19809a8d0 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe1980b1d30 0x7fe1980b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe1980b1d30 0x7fe1980b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52390/0 (socket says 172.21.15.119:52390) 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19ce00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe198099ca0 0x7fe19813ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46546/0 (socket says 172.21.15.119:46546) 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 -- 172.21.15.119:0/1068119971 learned_addr learned my addr 172.21.15.119:0/1068119971 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe197e00640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 0x7fe19809ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 -- 172.21.15.119:0/1068119971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 msgr2=0x7fe19809ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:35.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 0x7fe19809ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 -- 172.21.15.119:0/1068119971 >> v1:172.21.15.119:6789/0 conn(0x7fe198099ca0 legacy=0x7fe19813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe19d800640 1 -- 172.21.15.119:0/1068119971 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980b4510 con 0x7fe1980b1d30 2024-03-08T21:34:35.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe197e00640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 0x7fe19809ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:35.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.081+0000 7fe197400640 1 -- 172.21.15.119:0/1068119971 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606788128 0 0) 0x7fe1980b26c0 con 0x7fe198099ca0 2024-03-08T21:34:35.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19d800640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1980b1d30 0x7fe1980b2180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe19001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43670b3bb689fd6f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe197400640 1 -- 172.21.15.119:0/1068119971 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900a5810 con 0x7fe1980b1d30 2024-03-08T21:34:35.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe197400640 1 -- 172.21.15.119:0/1068119971 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1900a59b0 con 0x7fe1980b1d30 2024-03-08T21:34:35.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe197400640 1 -- 172.21.15.119:0/1068119971 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1900a5d80 con 0x7fe1980b1d30 2024-03-08T21:34:35.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 -- 172.21.15.119:0/1068119971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1980b1d30 msgr2=0x7fe1980b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1980b1d30 0x7fe1980b2180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e50 tx=0x7fe19001ca30 comp rx=0 tx=0).stop 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 -- 172.21.15.119:0/1068119971 shutdown_connections 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1980b1d30 0x7fe1980b2180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 --2- 172.21.15.119:0/1068119971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe19809a8d0 0x7fe19809ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 -- 172.21.15.119:0/1068119971 >> 172.21.15.119:0/1068119971 conn(0x7fe19806c620 msgr2=0x7fe19806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 -- 172.21.15.119:0/1068119971 shutdown_connections 2024-03-08T21:34:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.085+0000 7fe19f800640 1 -- 172.21.15.119:0/1068119971 wait complete. 2024-03-08T21:34:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 Processor -- start 2024-03-08T21:34:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- start start 2024-03-08T21:34:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe19809a8d0 0x7fe198071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1980b1d30 0x7fe198072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981522d0 con 0x7fe198099ca0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198152150 con 0x7fe19809a8d0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198152450 con 0x7fe1980b1d30 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52398/0 (socket says 172.21.15.119:52398) 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 -- 172.21.15.119:0/2962520623 learned_addr learned my addr 172.21.15.119:0/2962520623 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19d800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1980b1d30 0x7fe198072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe197e00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe19809a8d0 0x7fe198071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 -- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1980b1d30 msgr2=0x7fe198072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1980b1d30 0x7fe198072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 -- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe19809a8d0 msgr2=0x7fe198071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe19809a8d0 0x7fe198071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 -- 172.21.15.119:0/2962520623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980717e0 con 0x7fe198099ca0 2024-03-08T21:34:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19ce00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c480 tx=0x7fe18800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188018070 con 0x7fe198099ca0 2024-03-08T21:34:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188007500 con 0x7fe198099ca0 2024-03-08T21:34:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198070070 con 0x7fe198099ca0 2024-03-08T21:34:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188004a30 con 0x7fe198099ca0 2024-03-08T21:34:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19809d1e0 con 0x7fe198099ca0 2024-03-08T21:34:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.089+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198067db0 con 0x7fe198099ca0 2024-03-08T21:34:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.093+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe18801b070 con 0x7fe198099ca0 2024-03-08T21:34:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.093+0000 7fe194c00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 0x7fe174069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.093+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe188084b20 con 0x7fe198099ca0 2024-03-08T21:34:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.093+0000 7fe197e00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 0x7fe174069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.093+0000 7fe197e00640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 0x7fe174069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe198138d90 tx=0x7fe180008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.097+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fe188055140 con 0x7fe198099ca0 2024-03-08T21:34:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe19806ce20 con 0x7fe198099ca0 2024-03-08T21:34:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe194c00640 1 -- 172.21.15.119:0/2962520623 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16693 (secure 0 0 0) 0x7fe1880591e0 con 0x7fe198099ca0 2024-03-08T21:34:35.241 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:35.241 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:32.540475+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 msgr2=0x7fe174069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 0x7fe174069b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe198138d90 tx=0x7fe180008040 comp rx=0 tx=0).stop 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 msgr2=0x7fe19809c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c480 tx=0x7fe18800c940 comp rx=0 tx=0).stop 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 shutdown_connections 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe174067660 0x7fe174069b20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1980b1d30 0x7fe198072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe19809a8d0 0x7fe198071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 --2- 172.21.15.119:0/2962520623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe198099ca0 0x7fe19809c670 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 >> 172.21.15.119:0/2962520623 conn(0x7fe19806c620 msgr2=0x7fe1980b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 shutdown_connections 2024-03-08T21:34:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.253+0000 7fe19f800640 1 -- 172.21.15.119:0/2962520623 wait complete. 2024-03-08T21:34:35.262 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-08T21:34:35.262 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 Processor -- start 2024-03-08T21:34:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 -- start start 2024-03-08T21:34:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 0x7fe74c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c09b190 con 0x7fe74c09adb0 2024-03-08T21:34:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c09d240 con 0x7fe74c072fe0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe750a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c09d520 con 0x7fe74c1448b0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe749e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe74c09adb0 0x7fe74c1441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46550/0 (socket says 172.21.15.119:46550) 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe749e00640 1 -- 172.21.15.119:0/3255857708 learned_addr learned my addr 172.21.15.119:0/3255857708 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe74a800640 1 --2- 172.21.15.119:0/3255857708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 0x7fe74c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959984610 0 0) 0x7fe74c09b190 con 0x7fe74c09adb0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe730005740 con 0x7fe74c09adb0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671032736 0 0) 0x7fe74c09d240 con 0x7fe74c072fe0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c09b190 con 0x7fe74c072fe0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe74a800640 1 -- 172.21.15.119:0/3255857708 >> v1:172.21.15.160:6789/0 conn(0x7fe74c072fe0 legacy=0x7fe74c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379201321 0 0) 0x7fe730005740 con 0x7fe74c09adb0 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe74a800640 1 -- 172.21.15.119:0/3255857708 >> v1:172.21.15.119:6789/0 conn(0x7fe74c09adb0 legacy=0x7fe74c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.409+0000 7fe74a800640 1 -- 172.21.15.119:0/3255857708 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c143c50 con 0x7fe74c1448b0 2024-03-08T21:34:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe74a800640 1 --2- 172.21.15.119:0/3255857708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 0x7fe74c09cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe744009dc0 tx=0x7fe74401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6fd7f1b1d551cb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440b2070 con 0x7fe74c1448b0 2024-03-08T21:34:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7440a5610 con 0x7fe74c1448b0 2024-03-08T21:34:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe748a00640 1 -- 172.21.15.119:0/3255857708 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c001680 con 0x7fe74c1448b0 2024-03-08T21:34:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 -- 172.21.15.119:0/3255857708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 msgr2=0x7fe74c09cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 --2- 172.21.15.119:0/3255857708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 0x7fe74c09cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe744009dc0 tx=0x7fe74401c8b0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 -- 172.21.15.119:0/3255857708 shutdown_connections 2024-03-08T21:34:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 --2- 172.21.15.119:0/3255857708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1448b0 0x7fe74c09cbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 -- 172.21.15.119:0/3255857708 >> 172.21.15.119:0/3255857708 conn(0x7fe74c06c620 msgr2=0x7fe74c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 -- 172.21.15.119:0/3255857708 shutdown_connections 2024-03-08T21:34:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.413+0000 7fe750a00640 1 -- 172.21.15.119:0/3255857708 wait complete. 2024-03-08T21:34:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 Processor -- start 2024-03-08T21:34:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- start start 2024-03-08T21:34:35.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c09adb0 0x7fe74c13a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 0x7fe74c1398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c09a5e0 con 0x7fe74c072fe0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c09a460 con 0x7fe74c1448b0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c09a760 con 0x7fe74c09adb0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52414/0 (socket says 172.21.15.119:52414) 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 -- 172.21.15.119:0/397896858 learned_addr learned my addr 172.21.15.119:0/397896858 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749400640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c09adb0 0x7fe74c13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe74a800640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 0x7fe74c1398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 -- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c09adb0 msgr2=0x7fe74c13a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c09adb0 0x7fe74c13a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 -- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 msgr2=0x7fe74c1398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 0x7fe74c1398f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 -- 172.21.15.119:0/397896858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c13ee40 con 0x7fe74c072fe0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe74a800640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 0x7fe74c1398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe749e00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c750 tx=0x7fe73c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c005af0 con 0x7fe74c072fe0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005cb0 con 0x7fe74c072fe0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c138ca0 con 0x7fe74c072fe0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c005e60 con 0x7fe74c072fe0 2024-03-08T21:34:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.417+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c13b690 con 0x7fe74c072fe0 2024-03-08T21:34:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c1e3bc0 con 0x7fe74c072fe0 2024-03-08T21:34:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe73c0072b0 con 0x7fe74c072fe0 2024-03-08T21:34:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe742000640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 0x7fe72c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe73c0856c0 con 0x7fe74c072fe0 2024-03-08T21:34:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe749400640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 0x7fe72c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.421+0000 7fe749400640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 0x7fe72c069b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe738007fd0 tx=0x7fe738009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.425+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fe74c13ee40 con 0x7fe74c072fe0 2024-03-08T21:34:35.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.581+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe74c13c440 con 0x7fe72c067690 2024-03-08T21:34:35.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.585+0000 7fe742000640 1 -- 172.21.15.119:0/397896858 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238926 (secure 0 0 0) 0x7fe74c13c440 con 0x7fe72c067690 2024-03-08T21:34:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:35.578 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:35.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 msgr2=0x7fe72c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 0x7fe72c069b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe738007fd0 tx=0x7fe738009040 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 msgr2=0x7fe74c1e2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c750 tx=0x7fe73c00cc10 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 shutdown_connections 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe72c067690 0x7fe72c069b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe74c1448b0 0x7fe74c1398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c09adb0 0x7fe74c13a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 --2- 172.21.15.119:0/397896858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74c072fe0 0x7fe74c1e2d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 >> 172.21.15.119:0/397896858 conn(0x7fe74c06c620 msgr2=0x7fe74c13cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 shutdown_connections 2024-03-08T21:34:35.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.589+0000 7fe750a00640 1 -- 172.21.15.119:0/397896858 wait complete. 2024-03-08T21:34:35.597 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-08T21:34:34.424143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223728,"kb_used_data":3396,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750992,"statfs":{"total":773094113280,"available":772865015808,"internally_reserved":0,"allocated":3477504,"data_stored":2010669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904550"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522903+0000","last_change":"2024-03-08T21:34:29.522903+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522903+0000","last_undegraded":"2024-03-08T21:34:29.522903+0000","last_fullsized":"2024-03-08T21:34:29.522903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523622+0000","last_change":"2024-03-08T21:34:29.523622+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523622+0000","last_undegraded":"2024-03-08T21:34:29.523622+0000","last_fullsized":"2024-03-08T21:34:29.523622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.527527+0000","last_change":"2024-03-08T21:34:29.527527+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.527527+0000","last_undegraded":"2024-03-08T21:34:29.527527+0000","last_fullsized":"2024-03-08T21:34:29.527527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523507+0000","last_change":"2024-03-08T21:34:29.523507+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523507+0000","last_undegraded":"2024-03-08T21:34:29.523507+0000","last_fullsized":"2024-03-08T21:34:29.523507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522659+0000","last_change":"2024-03-08T21:34:29.522659+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522659+0000","last_undegraded":"2024-03-08T21:34:29.522659+0000","last_fullsized":"2024-03-08T21:34:29.522659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525164+0000","last_change":"2024-03-08T21:34:29.525164+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525164+0000","last_undegraded":"2024-03-08T21:34:29.525164+0000","last_fullsized":"2024-03-08T21:34:29.525164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522739+0000","last_change":"2024-03-08T21:34:29.522739+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522739+0000","last_undegraded":"2024-03-08T21:34:29.522739+0000","last_fullsized":"2024-03-08T21:34:29.522739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525836+0000","last_change":"2024-03-08T21:34:29.525836+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525836+0000","last_undegraded":"2024-03-08T21:34:29.525836+0000","last_fullsized":"2024-03-08T21:34:29.525836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522676+0000","last_change":"2024-03-08T21:34:29.522676+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522676+0000","last_undegraded":"2024-03-08T21:34:29.522676+0000","last_fullsized":"2024-03-08T21:34:29.522676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523673+0000","last_change":"2024-03-08T21:34:29.523673+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523673+0000","last_undegraded":"2024-03-08T21:34:29.523673+0000","last_fullsized":"2024-03-08T21:34:29.523673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525876+0000","last_change":"2024-03-08T21:34:29.525876+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525876+0000","last_undegraded":"2024-03-08T21:34:29.525876+0000","last_fullsized":"2024-03-08T21:34:29.525876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522913+0000","last_change":"2024-03-08T21:34:29.522913+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522913+0000","last_undegraded":"2024-03-08T21:34:29.522913+0000","last_fullsized":"2024-03-08T21:34:29.522913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525165+0000","last_change":"2024-03-08T21:34:29.525165+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525165+0000","last_undegraded":"2024-03-08T21:34:29.525165+0000","last_fullsized":"2024-03-08T21:34:29.525165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525372+0000","last_change":"2024-03-08T21:34:29.525372+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525372+0000","last_undegraded":"2024-03-08T21:34:29.525372+0000","last_fullsized":"2024-03-08T21:34:29.525372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525347+0000","last_change":"2024-03-08T21:34:29.525347+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525347+0000","last_undegraded":"2024-03-08T21:34:29.525347+0000","last_fullsized":"2024-03-08T21:34:29.525347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525320+0000","last_change":"2024-03-08T21:34:29.525320+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525320+0000","last_undegraded":"2024-03-08T21:34:29.525320+0000","last_fullsized":"2024-03-08T21:34:29.525320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522764+0000","last_change":"2024-03-08T21:34:29.522764+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522764+0000","last_undegraded":"2024-03-08T21:34:29.522764+0000","last_fullsized":"2024-03-08T21:34:29.522764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522926+0000","last_change":"2024-03-08T21:34:29.522926+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522926+0000","last_undegraded":"2024-03-08T21:34:29.522926+0000","last_fullsized":"2024-03-08T21:34:29.522926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T21:34:29.522634+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:29.522634+0000","last_peered":"2024-03-08T21:34:29.522634+0000","last_clean":"2024-03-08T21:34:29.522634+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:29.522634+0000","last_undegraded":"2024-03-08T21:34:29.522634+0000","last_fullsized":"2024-03-08T21:34:29.522634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":696291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":690474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:35.601 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 Processor -- start 2024-03-08T21:34:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 -- start start 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7014072fe0 0x7f701409cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701409b190 con 0x7f701409adb0 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701409d240 con 0x7f70141448b0 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f701a000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701409d520 con 0x7f7014072fe0 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7013400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f701409adb0 0x7f70141441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46554/0 (socket says 172.21.15.119:46554) 2024-03-08T21:34:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7013400640 1 -- 172.21.15.119:0/500011735 learned_addr learned my addr 172.21.15.119:0/500011735 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012a00640 1 --2- 172.21.15.119:0/500011735 >> v2:172.21.15.160:3300/0 conn(0x7f7014072fe0 0x7f701409cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758763015 0 0) 0x7f701409b190 con 0x7f701409adb0 2024-03-08T21:34:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff8003530 con 0x7f701409adb0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375571806 0 0) 0x7f6ff8003530 con 0x7f701409adb0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 >> v2:172.21.15.160:3300/0 conn(0x7f7014072fe0 msgr2=0x7f701409cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 --2- 172.21.15.119:0/500011735 >> v2:172.21.15.160:3300/0 conn(0x7f7014072fe0 0x7f701409cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 >> v1:172.21.15.160:6789/0 conn(0x7f70141448b0 legacy=0x7f701413d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014143c50 con 0x7f701409adb0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f7004001680 con 0x7f701409adb0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 >> v1:172.21.15.119:6789/0 conn(0x7f701409adb0 legacy=0x7f70141441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ff80039c0 0x7f6ff8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ff8004810 0x7f6ff8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f6ff800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701409d520 con 0x7f6ff80051d0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff800e280 con 0x7f6ff8004810 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff800e480 con 0x7f6ff80039c0 2024-03-08T21:34:35.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7013e00640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f6ff800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7012a00640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ff8004810 0x7f6ff8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.785+0000 7f7013400640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ff80039c0 0x7f6ff8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 -- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ff80039c0 msgr2=0x7f6ff8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ff80039c0 0x7f6ff8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 -- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ff8004810 msgr2=0x7f6ff8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ff8004810 0x7f6ff8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 -- 172.21.15.119:0/500011735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8003530 con 0x7f6ff80051d0 2024-03-08T21:34:35.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013400640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ff80039c0 0x7f6ff8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:35.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 -- 172.21.15.119:0/500011735 reap_dead start 2024-03-08T21:34:35.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7013e00640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f6ff800dbe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f700c001e70 tx=0x7f700c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f775d51ed42b41a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c001a90 con 0x7f6ff80051d0 2024-03-08T21:34:35.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c003ba0 con 0x7f6ff80051d0 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f7012000640 1 -- 172.21.15.119:0/500011735 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c005020 con 0x7f6ff80051d0 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 -- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 msgr2=0x7f6ff800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f6ff800dbe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f700c001e70 tx=0x7f700c01c780 comp rx=0 tx=0).stop 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 -- 172.21.15.119:0/500011735 shutdown_connections 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 --2- 172.21.15.119:0/500011735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f6ff800dbe0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 -- 172.21.15.119:0/500011735 >> 172.21.15.119:0/500011735 conn(0x7f701406c620 msgr2=0x7f701406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 -- 172.21.15.119:0/500011735 shutdown_connections 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.789+0000 7f701a000640 1 -- 172.21.15.119:0/500011735 wait complete. 2024-03-08T21:34:35.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 Processor -- start 2024-03-08T21:34:35.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- start start 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140b1580 0x7f70140b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70140affd0 0x7f70140b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701409cd70 con 0x7f6ff80051d0 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701409cbf0 con 0x7f70140affd0 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701409cef0 con 0x7f70140b1580 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52438/0 (socket says 172.21.15.119:52438) 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 -- 172.21.15.119:0/3323226791 learned_addr learned my addr 172.21.15.119:0/3323226791 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013e00640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70140affd0 0x7f70140b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7012a00640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140b1580 0x7f70140b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 -- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140b1580 msgr2=0x7f70140b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140b1580 0x7f70140b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 -- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70140affd0 msgr2=0x7f70140b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70140affd0 0x7f70140b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 -- 172.21.15.119:0/3323226791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7014140390 con 0x7f6ff80051d0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f7013400640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f700400e730 tx=0x7f700400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400c660 con 0x7f6ff80051d0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004018070 con 0x7f6ff80051d0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700400ca40 con 0x7f6ff80051d0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140b0e10 con 0x7f6ff80051d0 2024-03-08T21:34:35.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.793+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140b0990 con 0x7f6ff80051d0 2024-03-08T21:34:35.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014067db0 con 0x7f6ff80051d0 2024-03-08T21:34:35.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f700400cbe0 con 0x7f6ff80051d0 2024-03-08T21:34:35.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f700b400640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 0x7f6ff4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:35.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70040855c0 con 0x7f6ff80051d0 2024-03-08T21:34:35.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f7012a00640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 0x7f6ff4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:35.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.797+0000 7f7012a00640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 0x7f6ff4069b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70140b7e90 tx=0x7f7000008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:35.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.801+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f70040562d0 con 0x7f6ff80051d0 2024-03-08T21:34:35.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.949+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f701406d2a0 con 0x7f6ff4067660 2024-03-08T21:34:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.957+0000 7f700b400640 1 -- 172.21.15.119:0/3323226791 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238926 (secure 0 0 0) 0x7f701406d2a0 con 0x7f6ff4067660 2024-03-08T21:34:35.948 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:35.949 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:35.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 msgr2=0x7f6ff4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 0x7f6ff4069b20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70140b7e90 tx=0x7f7000008040 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 msgr2=0x7f70140b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f700400e730 tx=0x7f700400ebf0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 shutdown_connections 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6ff4067660 0x7f6ff4069b20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70140affd0 0x7f70140b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70140b1580 0x7f70140b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 --2- 172.21.15.119:0/3323226791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ff80051d0 0x7f70140b7810 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 >> 172.21.15.119:0/3323226791 conn(0x7f701406c620 msgr2=0x7f701413d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 shutdown_connections 2024-03-08T21:34:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:35.961+0000 7f701a000640 1 -- 172.21.15.119:0/3323226791 wait complete. 2024-03-08T21:34:35.968 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-08T21:34:34.424143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223728,"kb_used_data":3396,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750992,"statfs":{"total":773094113280,"available":772865015808,"internally_reserved":0,"allocated":3477504,"data_stored":2010669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904550"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522903+0000","last_change":"2024-03-08T21:34:29.522903+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522903+0000","last_undegraded":"2024-03-08T21:34:29.522903+0000","last_fullsized":"2024-03-08T21:34:29.522903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523622+0000","last_change":"2024-03-08T21:34:29.523622+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523622+0000","last_undegraded":"2024-03-08T21:34:29.523622+0000","last_fullsized":"2024-03-08T21:34:29.523622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.527527+0000","last_change":"2024-03-08T21:34:29.527527+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.527527+0000","last_undegraded":"2024-03-08T21:34:29.527527+0000","last_fullsized":"2024-03-08T21:34:29.527527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523507+0000","last_change":"2024-03-08T21:34:29.523507+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523507+0000","last_undegraded":"2024-03-08T21:34:29.523507+0000","last_fullsized":"2024-03-08T21:34:29.523507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522659+0000","last_change":"2024-03-08T21:34:29.522659+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522659+0000","last_undegraded":"2024-03-08T21:34:29.522659+0000","last_fullsized":"2024-03-08T21:34:29.522659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525164+0000","last_change":"2024-03-08T21:34:29.525164+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525164+0000","last_undegraded":"2024-03-08T21:34:29.525164+0000","last_fullsized":"2024-03-08T21:34:29.525164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522739+0000","last_change":"2024-03-08T21:34:29.522739+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522739+0000","last_undegraded":"2024-03-08T21:34:29.522739+0000","last_fullsized":"2024-03-08T21:34:29.522739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525836+0000","last_change":"2024-03-08T21:34:29.525836+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525836+0000","last_undegraded":"2024-03-08T21:34:29.525836+0000","last_fullsized":"2024-03-08T21:34:29.525836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522676+0000","last_change":"2024-03-08T21:34:29.522676+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522676+0000","last_undegraded":"2024-03-08T21:34:29.522676+0000","last_fullsized":"2024-03-08T21:34:29.522676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523673+0000","last_change":"2024-03-08T21:34:29.523673+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523673+0000","last_undegraded":"2024-03-08T21:34:29.523673+0000","last_fullsized":"2024-03-08T21:34:29.523673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525876+0000","last_change":"2024-03-08T21:34:29.525876+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525876+0000","last_undegraded":"2024-03-08T21:34:29.525876+0000","last_fullsized":"2024-03-08T21:34:29.525876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522913+0000","last_change":"2024-03-08T21:34:29.522913+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522913+0000","last_undegraded":"2024-03-08T21:34:29.522913+0000","last_fullsized":"2024-03-08T21:34:29.522913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525165+0000","last_change":"2024-03-08T21:34:29.525165+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525165+0000","last_undegraded":"2024-03-08T21:34:29.525165+0000","last_fullsized":"2024-03-08T21:34:29.525165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525372+0000","last_change":"2024-03-08T21:34:29.525372+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525372+0000","last_undegraded":"2024-03-08T21:34:29.525372+0000","last_fullsized":"2024-03-08T21:34:29.525372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525347+0000","last_change":"2024-03-08T21:34:29.525347+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525347+0000","last_undegraded":"2024-03-08T21:34:29.525347+0000","last_fullsized":"2024-03-08T21:34:29.525347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525320+0000","last_change":"2024-03-08T21:34:29.525320+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525320+0000","last_undegraded":"2024-03-08T21:34:29.525320+0000","last_fullsized":"2024-03-08T21:34:29.525320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522764+0000","last_change":"2024-03-08T21:34:29.522764+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522764+0000","last_undegraded":"2024-03-08T21:34:29.522764+0000","last_fullsized":"2024-03-08T21:34:29.522764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522926+0000","last_change":"2024-03-08T21:34:29.522926+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522926+0000","last_undegraded":"2024-03-08T21:34:29.522926+0000","last_fullsized":"2024-03-08T21:34:29.522926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T21:34:29.522634+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:29.522634+0000","last_peered":"2024-03-08T21:34:29.522634+0000","last_clean":"2024-03-08T21:34:29.522634+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:29.522634+0000","last_undegraded":"2024-03-08T21:34:29.522634+0000","last_fullsized":"2024-03-08T21:34:29.522634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":696291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":690474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:35.972 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:36.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 Processor -- start 2024-03-08T21:34:36.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 -- start start 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd7e809adb0 0x7fd7e809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 0x7fd7e813d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e809b190 con 0x7fd7e8072fe0 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e809d240 con 0x7fd7e809adb0 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7f0800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e809d520 con 0x7fd7e81448b0 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7ee800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 0x7fd7e813d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7ede00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd7e809adb0 0x7fd7e809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7ede00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd7e809adb0 0x7fd7e809cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:32782/0 (socket says 172.21.15.119:32782) 2024-03-08T21:34:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.157+0000 7fd7ede00640 1 -- 172.21.15.119:0/2802648039 learned_addr learned my addr 172.21.15.119:0/2802648039 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ede00640 1 -- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 msgr2=0x7fd7e813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ede00640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 0x7fd7e813d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ede00640 1 -- 172.21.15.119:0/2802648039 >> v1:172.21.15.160:6789/0 conn(0x7fd7e8072fe0 legacy=0x7fd7e81441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ede00640 1 -- 172.21.15.119:0/2802648039 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8143c50 con 0x7fd7e809adb0 2024-03-08T21:34:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ee800640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 0x7fd7e813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7ede00640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e809cbf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009870 tx=0x7fd7dc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=731b643eca38f587 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7eca00640 1 -- 172.21.15.119:0/2802648039 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0aa680 con 0x7fd7e809adb0 2024-03-08T21:34:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7eca00640 1 -- 172.21.15.119:0/2802648039 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc0af070 con 0x7fd7e809adb0 2024-03-08T21:34:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7eca00640 1 -- 172.21.15.119:0/2802648039 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc0aaa40 con 0x7fd7e809adb0 2024-03-08T21:34:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 -- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 msgr2=0x7fd7e809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e809cbf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009870 tx=0x7fd7dc01c560 comp rx=0 tx=0).stop 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 -- 172.21.15.119:0/2802648039 shutdown_connections 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e81448b0 0x7fd7e813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2802648039 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e809cbf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 -- 172.21.15.119:0/2802648039 >> 172.21.15.119:0/2802648039 conn(0x7fd7e806c620 msgr2=0x7fd7e806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 -- 172.21.15.119:0/2802648039 shutdown_connections 2024-03-08T21:34:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.161+0000 7fd7f0800640 1 -- 172.21.15.119:0/2802648039 wait complete. 2024-03-08T21:34:36.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 Processor -- start 2024-03-08T21:34:36.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- start start 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e8072fe0 0x7fd7e8071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e81e01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151180 con 0x7fd7e81448b0 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151000 con 0x7fd7e809adb0 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8151300 con 0x7fd7e8072fe0 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52446/0 (socket says 172.21.15.119:52446) 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 -- 172.21.15.119:0/2665149797 learned_addr learned my addr 172.21.15.119:0/2665149797 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ede00640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e8072fe0 0x7fd7e8071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ed400640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e81e01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 -- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e8072fe0 msgr2=0x7fd7e8071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e8072fe0 0x7fd7e8071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 -- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 msgr2=0x7fd7e81e01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e81e01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 -- 172.21.15.119:0/2665149797 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80709b0 con 0x7fd7e81448b0 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ed400640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e81e01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7ee800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400efc0 tx=0x7fd7e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4018030 con 0x7fd7e81448b0 2024-03-08T21:34:36.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e813ebd0 con 0x7fd7e81448b0 2024-03-08T21:34:36.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400cde0 con 0x7fd7e81448b0 2024-03-08T21:34:36.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4003bc0 con 0x7fd7e81448b0 2024-03-08T21:34:36.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.165+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e8070c20 con 0x7fd7e81448b0 2024-03-08T21:34:36.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8067db0 con 0x7fd7e81448b0 2024-03-08T21:34:36.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd7e401b070 con 0x7fd7e81448b0 2024-03-08T21:34:36.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7e2000640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7e40861e0 con 0x7fd7e81448b0 2024-03-08T21:34:36.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7ede00640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.169+0000 7fd7ede00640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 0x7fd7cc069b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ae000 tx=0x7fd7dc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.173+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd7e4022070 con 0x7fd7e81448b0 2024-03-08T21:34:36.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.325+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7e813bcd0 con 0x7fd7cc067690 2024-03-08T21:34:36.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.329+0000 7fd7e2000640 1 -- 172.21.15.119:0/2665149797 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238926 (secure 0 0 0) 0x7fd7e813bcd0 con 0x7fd7cc067690 2024-03-08T21:34:36.322 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:36.323 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 msgr2=0x7fd7cc069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 0x7fd7cc069b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc0ae000 tx=0x7fd7dc0a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 msgr2=0x7fd7e81e0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400efc0 tx=0x7fd7e4009f90 comp rx=0 tx=0).stop 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 shutdown_connections 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd7cc067690 0x7fd7cc069b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e81448b0 0x7fd7e81e0700 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7e809adb0 0x7fd7e81e01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 --2- 172.21.15.119:0/2665149797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7e8072fe0 0x7fd7e8071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 >> 172.21.15.119:0/2665149797 conn(0x7fd7e806c620 msgr2=0x7fd7e8073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 shutdown_connections 2024-03-08T21:34:36.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.333+0000 7fd7f0800640 1 -- 172.21.15.119:0/2665149797 wait complete. 2024-03-08T21:34:36.343 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-08T21:34:34.424143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223728,"kb_used_data":3396,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750992,"statfs":{"total":773094113280,"available":772865015808,"internally_reserved":0,"allocated":3477504,"data_stored":2010669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904550"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522903+0000","last_change":"2024-03-08T21:34:29.522903+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522903+0000","last_undegraded":"2024-03-08T21:34:29.522903+0000","last_fullsized":"2024-03-08T21:34:29.522903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523622+0000","last_change":"2024-03-08T21:34:29.523622+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523622+0000","last_undegraded":"2024-03-08T21:34:29.523622+0000","last_fullsized":"2024-03-08T21:34:29.523622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.527527+0000","last_change":"2024-03-08T21:34:29.527527+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.527527+0000","last_undegraded":"2024-03-08T21:34:29.527527+0000","last_fullsized":"2024-03-08T21:34:29.527527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523507+0000","last_change":"2024-03-08T21:34:29.523507+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523507+0000","last_undegraded":"2024-03-08T21:34:29.523507+0000","last_fullsized":"2024-03-08T21:34:29.523507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522659+0000","last_change":"2024-03-08T21:34:29.522659+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522659+0000","last_undegraded":"2024-03-08T21:34:29.522659+0000","last_fullsized":"2024-03-08T21:34:29.522659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525164+0000","last_change":"2024-03-08T21:34:29.525164+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525164+0000","last_undegraded":"2024-03-08T21:34:29.525164+0000","last_fullsized":"2024-03-08T21:34:29.525164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522739+0000","last_change":"2024-03-08T21:34:29.522739+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522739+0000","last_undegraded":"2024-03-08T21:34:29.522739+0000","last_fullsized":"2024-03-08T21:34:29.522739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525836+0000","last_change":"2024-03-08T21:34:29.525836+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525836+0000","last_undegraded":"2024-03-08T21:34:29.525836+0000","last_fullsized":"2024-03-08T21:34:29.525836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522676+0000","last_change":"2024-03-08T21:34:29.522676+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522676+0000","last_undegraded":"2024-03-08T21:34:29.522676+0000","last_fullsized":"2024-03-08T21:34:29.522676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.523673+0000","last_change":"2024-03-08T21:34:29.523673+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.523673+0000","last_undegraded":"2024-03-08T21:34:29.523673+0000","last_fullsized":"2024-03-08T21:34:29.523673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525876+0000","last_change":"2024-03-08T21:34:29.525876+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525876+0000","last_undegraded":"2024-03-08T21:34:29.525876+0000","last_fullsized":"2024-03-08T21:34:29.525876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522913+0000","last_change":"2024-03-08T21:34:29.522913+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522913+0000","last_undegraded":"2024-03-08T21:34:29.522913+0000","last_fullsized":"2024-03-08T21:34:29.522913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525165+0000","last_change":"2024-03-08T21:34:29.525165+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525165+0000","last_undegraded":"2024-03-08T21:34:29.525165+0000","last_fullsized":"2024-03-08T21:34:29.525165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525372+0000","last_change":"2024-03-08T21:34:29.525372+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525372+0000","last_undegraded":"2024-03-08T21:34:29.525372+0000","last_fullsized":"2024-03-08T21:34:29.525372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525347+0000","last_change":"2024-03-08T21:34:29.525347+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525347+0000","last_undegraded":"2024-03-08T21:34:29.525347+0000","last_fullsized":"2024-03-08T21:34:29.525347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.525320+0000","last_change":"2024-03-08T21:34:29.525320+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.525320+0000","last_undegraded":"2024-03-08T21:34:29.525320+0000","last_fullsized":"2024-03-08T21:34:29.525320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:29.510288+0000","last_change":"2024-03-08T21:34:29.510288+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.510288+0000","last_undegraded":"2024-03-08T21:34:29.510288+0000","last_fullsized":"2024-03-08T21:34:29.510288+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522764+0000","last_change":"2024-03-08T21:34:29.522764+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522764+0000","last_undegraded":"2024-03-08T21:34:29.522764+0000","last_fullsized":"2024-03-08T21:34:29.522764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-08T21:34:30.519591+0000","last_change":"2024-03-08T21:34:30.519591+0000","last_active":"2024-03-08T21:34:30.519591+0000","last_peered":"2024-03-08T21:34:30.519591+0000","last_clean":"2024-03-08T21:34:30.519591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:30.519591+0000","last_undegraded":"2024-03-08T21:34:30.519591+0000","last_fullsized":"2024-03-08T21:34:30.519591+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2024-03-08T21:34:29.522926+0000","last_change":"2024-03-08T21:34:29.522926+0000","last_active":"2024-03-08T21:34:29.510288+0000","last_peered":"2024-03-08T21:34:29.510288+0000","last_clean":"2024-03-08T21:34:29.510288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-08T21:34:29.522926+0000","last_undegraded":"2024-03-08T21:34:29.522926+0000","last_fullsized":"2024-03-08T21:34:29.522926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-08T21:34:29.522634+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:29.522634+0000","last_peered":"2024-03-08T21:34:29.522634+0000","last_clean":"2024-03-08T21:34:29.522634+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:29.522634+0000","last_undegraded":"2024-03-08T21:34:29.522634+0000","last_fullsized":"2024-03-08T21:34:29.522634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":884736,"data_stored":696291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":105923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":100106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":690474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-08T21:34:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-08T21:34:36.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-08T21:34:36.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-08T21:34:36.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522903+0000', 'last_change': '2024-03-08T21:34:29.522903+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522903+0000', 'last_undegraded': '2024-03-08T21:34:29.522903+0000', 'last_fullsized': '2024-03-08T21:34:29.522903+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.523622+0000', 'last_change': '2024-03-08T21:34:29.523622+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.523622+0000', 'last_undegraded': '2024-03-08T21:34:29.523622+0000', 'last_fullsized': '2024-03-08T21:34:29.523622+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.527527+0000', 'last_change': '2024-03-08T21:34:29.527527+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.527527+0000', 'last_undegraded': '2024-03-08T21:34:29.527527+0000', 'last_fullsized': '2024-03-08T21:34:29.527527+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-03-08T21:34:36.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.523507+0000', 'last_change': '2024-03-08T21:34:29.523507+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.523507+0000', 'last_undegraded': '2024-03-08T21:34:29.523507+0000', 'last_fullsized': '2024-03-08T21:34:29.523507+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-03-08T21:34:36.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522659+0000', 'last_change': '2024-03-08T21:34:29.522659+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522659+0000', 'last_undegraded': '2024-03-08T21:34:29.522659+0000', 'last_fullsized': '2024-03-08T21:34:29.522659+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525164+0000', 'last_change': '2024-03-08T21:34:29.525164+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525164+0000', 'last_undegraded': '2024-03-08T21:34:29.525164+0000', 'last_fullsized': '2024-03-08T21:34:29.525164+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-03-08T21:34:36.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522739+0000', 'last_change': '2024-03-08T21:34:29.522739+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522739+0000', 'last_undegraded': '2024-03-08T21:34:29.522739+0000', 'last_fullsized': '2024-03-08T21:34:29.522739+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525836+0000', 'last_change': '2024-03-08T21:34:29.525836+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525836+0000', 'last_undegraded': '2024-03-08T21:34:29.525836+0000', 'last_fullsized': '2024-03-08T21:34:29.525836+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-03-08T21:34:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522676+0000', 'last_change': '2024-03-08T21:34:29.522676+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522676+0000', 'last_undegraded': '2024-03-08T21:34:29.522676+0000', 'last_fullsized': '2024-03-08T21:34:29.522676+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.523673+0000', 'last_change': '2024-03-08T21:34:29.523673+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.523673+0000', 'last_undegraded': '2024-03-08T21:34:29.523673+0000', 'last_fullsized': '2024-03-08T21:34:29.523673+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525876+0000', 'last_change': '2024-03-08T21:34:29.525876+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525876+0000', 'last_undegraded': '2024-03-08T21:34:29.525876+0000', 'last_fullsized': '2024-03-08T21:34:29.525876+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-08T21:34:36.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522913+0000', 'last_change': '2024-03-08T21:34:29.522913+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522913+0000', 'last_undegraded': '2024-03-08T21:34:29.522913+0000', 'last_fullsized': '2024-03-08T21:34:29.522913+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525165+0000', 'last_change': '2024-03-08T21:34:29.525165+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525165+0000', 'last_undegraded': '2024-03-08T21:34:29.525165+0000', 'last_fullsized': '2024-03-08T21:34:29.525165+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525372+0000', 'last_change': '2024-03-08T21:34:29.525372+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525372+0000', 'last_undegraded': '2024-03-08T21:34:29.525372+0000', 'last_fullsized': '2024-03-08T21:34:29.525372+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-08T21:34:36.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525347+0000', 'last_change': '2024-03-08T21:34:29.525347+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525347+0000', 'last_undegraded': '2024-03-08T21:34:29.525347+0000', 'last_fullsized': '2024-03-08T21:34:29.525347+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-03-08T21:34:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.525320+0000', 'last_change': '2024-03-08T21:34:29.525320+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.525320+0000', 'last_undegraded': '2024-03-08T21:34:29.525320+0000', 'last_fullsized': '2024-03-08T21:34:29.525320+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:29.510288+0000', 'last_change': '2024-03-08T21:34:29.510288+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.510288+0000', 'last_undegraded': '2024-03-08T21:34:29.510288+0000', 'last_fullsized': '2024-03-08T21:34:29.510288+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522764+0000', 'last_change': '2024-03-08T21:34:29.522764+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522764+0000', 'last_undegraded': '2024-03-08T21:34:29.522764+0000', 'last_fullsized': '2024-03-08T21:34:29.522764+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-08T21:34:30.519591+0000', 'last_change': '2024-03-08T21:34:30.519591+0000', 'last_active': '2024-03-08T21:34:30.519591+0000', 'last_peered': '2024-03-08T21:34:30.519591+0000', 'last_clean': '2024-03-08T21:34:30.519591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:30.519591+0000', 'last_undegraded': '2024-03-08T21:34:30.519591+0000', 'last_fullsized': '2024-03-08T21:34:30.519591+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:30.519591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-03-08T21:34:36.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2024-03-08T21:34:29.522926+0000', 'last_change': '2024-03-08T21:34:29.522926+0000', 'last_active': '2024-03-08T21:34:29.510288+0000', 'last_peered': '2024-03-08T21:34:29.510288+0000', 'last_clean': '2024-03-08T21:34:29.510288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-08T21:34:29.522926+0000', 'last_undegraded': '2024-03-08T21:34:29.522926+0000', 'last_fullsized': '2024-03-08T21:34:29.522926+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'last_clean_scrub_stamp': '2024-03-08T21:34:29.510288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-08T21:34:36.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-08T21:34:36.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 Processor -- start 2024-03-08T21:34:36.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 -- start start 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29140ba2c0 0x7f29140b9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29140bb400 con 0x7f291406f540 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291406ec00 con 0x7f29140bb020 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f291be00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291406ef70 con 0x7f29140ba2c0 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2918a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29140ba2c0 0x7f29140b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2919e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f291406f540 0x7f2914151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46568/0 (socket says 172.21.15.119:46568) 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2919e00640 1 -- 172.21.15.119:0/2776617403 learned_addr learned my addr 172.21.15.119:0/2776617403 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2918a00640 1 -- 172.21.15.119:0/2776617403 >> v1:172.21.15.160:6789/0 conn(0x7f29140bb020 legacy=0x7f2914144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2918a00640 1 -- 172.21.15.119:0/2776617403 >> v1:172.21.15.119:6789/0 conn(0x7f291406f540 legacy=0x7f2914151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2918a00640 1 -- 172.21.15.119:0/2776617403 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914072b40 con 0x7f29140ba2c0 2024-03-08T21:34:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.529+0000 7f2913e00640 1 -- 172.21.15.119:0/2776617403 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783352982 0 0) 0x7f29140bb400 con 0x7f291406f540 2024-03-08T21:34:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f2918a00640 1 --2- 172.21.15.119:0/2776617403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140ba2c0 0x7f29140b9480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29000097c0 tx=0x7f290001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa4cd57c8b9297c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f2913e00640 1 -- 172.21.15.119:0/2776617403 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000b0070 con 0x7f29140ba2c0 2024-03-08T21:34:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f2913e00640 1 -- 172.21.15.119:0/2776617403 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000ab600 con 0x7f29140ba2c0 2024-03-08T21:34:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f2913e00640 1 -- 172.21.15.119:0/2776617403 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000ab9d0 con 0x7f29140ba2c0 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 -- 172.21.15.119:0/2776617403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140ba2c0 msgr2=0x7f29140b9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 --2- 172.21.15.119:0/2776617403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140ba2c0 0x7f29140b9480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29000097c0 tx=0x7f290001c460 comp rx=0 tx=0).stop 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 -- 172.21.15.119:0/2776617403 shutdown_connections 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 --2- 172.21.15.119:0/2776617403 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140ba2c0 0x7f29140b9480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 -- 172.21.15.119:0/2776617403 >> 172.21.15.119:0/2776617403 conn(0x7f2914099a40 msgr2=0x7f29140ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 -- 172.21.15.119:0/2776617403 shutdown_connections 2024-03-08T21:34:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.533+0000 7f291be00640 1 -- 172.21.15.119:0/2776617403 wait complete. 2024-03-08T21:34:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 Processor -- start 2024-03-08T21:34:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- start start 2024-03-08T21:34:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 0x7f291409bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291409ce70 0x7f291409e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914155af0 con 0x7f29140bb020 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914155970 con 0x7f291406f540 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2914155c70 con 0x7f291409ce70 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52464/0 (socket says 172.21.15.119:52464) 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 -- 172.21.15.119:0/1873721329 learned_addr learned my addr 172.21.15.119:0/1873721329 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 -- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291409ce70 msgr2=0x7f291409e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291409ce70 0x7f291409e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 -- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 msgr2=0x7f291409bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2919400640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 0x7f291409bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 0x7f291409bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 -- 172.21.15.119:0/1873721329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291409aa00 con 0x7f29140bb020 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2919400640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 0x7f291409bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2918a00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2900019070 tx=0x7f290001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000b0050 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000bc070 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000b5a50 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291409d350 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291409d910 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.537+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291409abd0 con 0x7f29140bb020 2024-03-08T21:34:36.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.541+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f29000ab4a0 con 0x7f29140bb020 2024-03-08T21:34:36.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.541+0000 7f2911600640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 0x7f28f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.541+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29001200d0 con 0x7f29140bb020 2024-03-08T21:34:36.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.541+0000 7f2919400640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 0x7f28f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.541+0000 7f2919400640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 0x7f28f4069b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f291409a990 tx=0x7f29080073e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.545+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2900016050 con 0x7f29140bb020 2024-03-08T21:34:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2914067db0 con 0x7f29140bb020 2024-03-08T21:34:36.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f2911600640 1 -- 172.21.15.119:0/1873721329 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1302 (secure 0 0 0) 0x7f29000f0d40 con 0x7f29140bb020 2024-03-08T21:34:36.741 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:36.741 INFO:teuthology.orchestra.run.smithi119.stdout:{"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":30,"num_osds":8,"num_up_osds":8,"osd_up_since":1709933615,"num_in_osds":8,"osd_in_since":1709933605,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":229507072,"bytes_avail":772864606208,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5007}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-03-08T21:34:36.424612+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 msgr2=0x7f28f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 0x7f28f4069b20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f291409a990 tx=0x7f29080073e0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 msgr2=0x7f291409e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2900019070 tx=0x7f290001aca0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 shutdown_connections 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28f4067660 0x7f28f4069b20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291409ce70 0x7f291409e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29140bb020 0x7f291409e350 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 --2- 172.21.15.119:0/1873721329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291406f540 0x7f291409bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 >> 172.21.15.119:0/1873721329 conn(0x7f2914099a40 msgr2=0x7f29141430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 shutdown_connections 2024-03-08T21:34:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.753+0000 7f291be00640 1 -- 172.21.15.119:0/1873721329 wait complete. 2024-03-08T21:34:36.761 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-08T21:34:36.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:36.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 Processor -- start 2024-03-08T21:34:36.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 -- start start 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 0x7f31881483d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3188144e60 0x7f3188145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880b7f80 con 0x7f31880b7ba0 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3188145850 con 0x7f3188144e60 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318fc00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31881489f0 con 0x7f318813f330 2024-03-08T21:34:36.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318d200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f31880b7ba0 0x7f318813ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46574/0 (socket says 172.21.15.119:46574) 2024-03-08T21:34:36.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318d200640 1 -- 172.21.15.119:0/3069805869 learned_addr learned my addr 172.21.15.119:0/3069805869 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:36.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318dc00640 1 --2- 172.21.15.119:0/3069805869 >> v2:172.21.15.119:3300/0 conn(0x7f3188144e60 0x7f3188145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318dc00640 1 -- 172.21.15.119:0/3069805869 >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 msgr2=0x7f31881483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:36.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f317fe00640 1 --2- 172.21.15.119:0/3069805869 >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 0x7f31881483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f3187e00640 1 -- 172.21.15.119:0/3069805869 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526242557 0 0) 0x7f31880b7f80 con 0x7f31880b7ba0 2024-03-08T21:34:36.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318dc00640 1 --2- 172.21.15.119:0/3069805869 >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 0x7f31881483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318dc00640 1 -- 172.21.15.119:0/3069805869 >> v1:172.21.15.119:6789/0 conn(0x7f31880b7ba0 legacy=0x7f318813ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f318dc00640 1 -- 172.21.15.119:0/3069805869 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188148cd0 con 0x7f3188144e60 2024-03-08T21:34:36.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.909+0000 7f317fe00640 1 --2- 172.21.15.119:0/3069805869 >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 0x7f31881483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:36.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318dc00640 1 --2- 172.21.15.119:0/3069805869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3188144e60 0x7f3188145310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3188071230 tx=0x7f318001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315aab18a9c3b481 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f3187e00640 1 -- 172.21.15.119:0/3069805869 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800b2070 con 0x7f3188144e60 2024-03-08T21:34:36.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f3187e00640 1 -- 172.21.15.119:0/3069805869 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800a5900 con 0x7f3188144e60 2024-03-08T21:34:36.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f3187e00640 1 -- 172.21.15.119:0/3069805869 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800a5cd0 con 0x7f3188144e60 2024-03-08T21:34:36.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- 172.21.15.119:0/3069805869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3188144e60 msgr2=0x7f3188145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 --2- 172.21.15.119:0/3069805869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3188144e60 0x7f3188145310 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3188071230 tx=0x7f318001c930 comp rx=0 tx=0).stop 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- 172.21.15.119:0/3069805869 shutdown_connections 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 --2- 172.21.15.119:0/3069805869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3188144e60 0x7f3188145310 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 --2- 172.21.15.119:0/3069805869 >> v2:172.21.15.160:3300/0 conn(0x7f318813f330 0x7f31881483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- 172.21.15.119:0/3069805869 >> 172.21.15.119:0/3069805869 conn(0x7f31880b94a0 msgr2=0x7f31880b9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- 172.21.15.119:0/3069805869 shutdown_connections 2024-03-08T21:34:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- 172.21.15.119:0/3069805869 wait complete. 2024-03-08T21:34:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 Processor -- start 2024-03-08T21:34:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.913+0000 7f318fc00640 1 -- start start 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f318813f330 0x7f31881e27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3188144e60 0x7f31881e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188152130 con 0x7f31880b7ba0 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318809ea10 con 0x7f318813f330 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31881522b0 con 0x7f3188144e60 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52478/0 (socket says 172.21.15.119:52478) 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 -- 172.21.15.119:0/2503742045 learned_addr learned my addr 172.21.15.119:0/2503742045 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 -- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3188144e60 msgr2=0x7f31881e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3188144e60 0x7f31881e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 -- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f318813f330 msgr2=0x7f31881e27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f318813f330 0x7f31881e27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 -- 172.21.15.119:0/2503742045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31881471a0 con 0x7f31880b7ba0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318d200640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f317800c520 tx=0x7f317800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178018070 con 0x7f31880b7ba0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31780074e0 con 0x7f31880b7ba0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31780049f0 con 0x7f31880b7ba0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3188147480 con 0x7f31880b7ba0 2024-03-08T21:34:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3188097610 con 0x7f31880b7ba0 2024-03-08T21:34:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3188067db0 con 0x7f31880b7ba0 2024-03-08T21:34:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.917+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3178004b90 con 0x7f31880b7ba0 2024-03-08T21:34:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.921+0000 7f3185600640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 0x7f3164069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.921+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3178084c70 con 0x7f31880b7ba0 2024-03-08T21:34:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.921+0000 7f317fe00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 0x7f3164069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.921+0000 7f317fe00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 0x7f3164069b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3188096b60 tx=0x7f3170008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:36.921+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f31780558e0 con 0x7f31880b7ba0 2024-03-08T21:34:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.073+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f318814f330 con 0x7f3164067660 2024-03-08T21:34:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.081+0000 7f3185600640 1 -- 172.21.15.119:0/2503742045 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251951 (secure 0 0 0) 0x7f318814f330 con 0x7f3164067660 2024-03-08T21:34:37.071 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:37.072 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 msgr2=0x7f3164069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 0x7f3164069b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3188096b60 tx=0x7f3170008040 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 msgr2=0x7f318809b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f317800c520 tx=0x7f317800c9e0 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 shutdown_connections 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3164067660 0x7f3164069b20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3188144e60 0x7f31881e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f318813f330 0x7f31881e27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 --2- 172.21.15.119:0/2503742045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31880b7ba0 0x7f318809b600 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 >> 172.21.15.119:0/2503742045 conn(0x7f31880b94a0 msgr2=0x7f318806e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 shutdown_connections 2024-03-08T21:34:37.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:37.085+0000 7f318fc00640 1 -- 172.21.15.119:0/2503742045 wait complete. 2024-03-08T21:34:37.094 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-03-08T21:34:36.424439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224128,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750592,"statfs":{"total":773094113280,"available":772864606208,"internally_reserved":0,"allocated":3874816,"data_stored":2187676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453088+0000","last_change":"2024-03-08T21:34:31.552339+0000","last_active":"2024-03-08T21:34:33.453088+0000","last_peered":"2024-03-08T21:34:33.453088+0000","last_clean":"2024-03-08T21:34:33.453088+0000","last_became_active":"2024-03-08T21:34:31.552088+0000","last_became_peered":"2024-03-08T21:34:31.552088+0000","last_unstale":"2024-03-08T21:34:33.453088+0000","last_undegraded":"2024-03-08T21:34:33.453088+0000","last_fullsized":"2024-03-08T21:34:33.453088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:51:53.552856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554940+0000","last_change":"2024-03-08T21:34:31.561911+0000","last_active":"2024-03-08T21:34:32.554940+0000","last_peered":"2024-03-08T21:34:32.554940+0000","last_clean":"2024-03-08T21:34:32.554940+0000","last_became_active":"2024-03-08T21:34:31.561314+0000","last_became_peered":"2024-03-08T21:34:31.561314+0000","last_unstale":"2024-03-08T21:34:32.554940+0000","last_undegraded":"2024-03-08T21:34:32.554940+0000","last_fullsized":"2024-03-08T21:34:32.554940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:49.799861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966421+0000","last_change":"2024-03-08T21:34:31.560897+0000","last_active":"2024-03-08T21:34:33.966421+0000","last_peered":"2024-03-08T21:34:33.966421+0000","last_clean":"2024-03-08T21:34:33.966421+0000","last_became_active":"2024-03-08T21:34:31.559447+0000","last_became_peered":"2024-03-08T21:34:31.559447+0000","last_unstale":"2024-03-08T21:34:33.966421+0000","last_undegraded":"2024-03-08T21:34:33.966421+0000","last_fullsized":"2024-03-08T21:34:33.966421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545923+0000","last_change":"2024-03-08T21:34:31.558451+0000","last_active":"2024-03-08T21:34:33.545923+0000","last_peered":"2024-03-08T21:34:33.545923+0000","last_clean":"2024-03-08T21:34:33.545923+0000","last_became_active":"2024-03-08T21:34:31.558186+0000","last_became_peered":"2024-03-08T21:34:31.558186+0000","last_unstale":"2024-03-08T21:34:33.545923+0000","last_undegraded":"2024-03-08T21:34:33.545923+0000","last_fullsized":"2024-03-08T21:34:33.545923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:48:23.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553315+0000","last_change":"2024-03-08T21:34:31.562104+0000","last_active":"2024-03-08T21:34:32.553315+0000","last_peered":"2024-03-08T21:34:32.553315+0000","last_clean":"2024-03-08T21:34:32.553315+0000","last_became_active":"2024-03-08T21:34:31.561603+0000","last_became_peered":"2024-03-08T21:34:31.561603+0000","last_unstale":"2024-03-08T21:34:32.553315+0000","last_undegraded":"2024-03-08T21:34:32.553315+0000","last_fullsized":"2024-03-08T21:34:32.553315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:02:58.324720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554221+0000","last_change":"2024-03-08T21:34:31.560211+0000","last_active":"2024-03-08T21:34:32.554221+0000","last_peered":"2024-03-08T21:34:32.554221+0000","last_clean":"2024-03-08T21:34:32.554221+0000","last_became_active":"2024-03-08T21:34:31.559765+0000","last_became_peered":"2024-03-08T21:34:31.559765+0000","last_unstale":"2024-03-08T21:34:32.554221+0000","last_undegraded":"2024-03-08T21:34:32.554221+0000","last_fullsized":"2024-03-08T21:34:32.554221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966754+0000","last_change":"2024-03-08T21:34:31.554261+0000","last_active":"2024-03-08T21:34:33.966754+0000","last_peered":"2024-03-08T21:34:33.966754+0000","last_clean":"2024-03-08T21:34:33.966754+0000","last_became_active":"2024-03-08T21:34:31.552930+0000","last_became_peered":"2024-03-08T21:34:31.552930+0000","last_unstale":"2024-03-08T21:34:33.966754+0000","last_undegraded":"2024-03-08T21:34:33.966754+0000","last_fullsized":"2024-03-08T21:34:33.966754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966108+0000","last_change":"2024-03-08T21:34:31.561150+0000","last_active":"2024-03-08T21:34:33.966108+0000","last_peered":"2024-03-08T21:34:33.966108+0000","last_clean":"2024-03-08T21:34:33.966108+0000","last_became_active":"2024-03-08T21:34:31.558489+0000","last_became_peered":"2024-03-08T21:34:31.558489+0000","last_unstale":"2024-03-08T21:34:33.966108+0000","last_undegraded":"2024-03-08T21:34:33.966108+0000","last_fullsized":"2024-03-08T21:34:33.966108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:28.216676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551689+0000","last_change":"2024-03-08T21:34:31.549765+0000","last_active":"2024-03-08T21:34:32.551689+0000","last_peered":"2024-03-08T21:34:32.551689+0000","last_clean":"2024-03-08T21:34:32.551689+0000","last_became_active":"2024-03-08T21:34:31.549143+0000","last_became_peered":"2024-03-08T21:34:31.549143+0000","last_unstale":"2024-03-08T21:34:32.551689+0000","last_undegraded":"2024-03-08T21:34:32.551689+0000","last_fullsized":"2024-03-08T21:34:32.551689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:46:48.914141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546203+0000","last_change":"2024-03-08T21:34:31.567097+0000","last_active":"2024-03-08T21:34:33.546203+0000","last_peered":"2024-03-08T21:34:33.546203+0000","last_clean":"2024-03-08T21:34:33.546203+0000","last_became_active":"2024-03-08T21:34:31.566774+0000","last_became_peered":"2024-03-08T21:34:31.566774+0000","last_unstale":"2024-03-08T21:34:33.546203+0000","last_undegraded":"2024-03-08T21:34:33.546203+0000","last_fullsized":"2024-03-08T21:34:33.546203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.967178+0000","last_change":"2024-03-08T21:34:31.546258+0000","last_active":"2024-03-08T21:34:33.967178+0000","last_peered":"2024-03-08T21:34:33.967178+0000","last_clean":"2024-03-08T21:34:33.967178+0000","last_became_active":"2024-03-08T21:34:31.545472+0000","last_became_peered":"2024-03-08T21:34:31.545472+0000","last_unstale":"2024-03-08T21:34:33.967178+0000","last_undegraded":"2024-03-08T21:34:33.967178+0000","last_fullsized":"2024-03-08T21:34:33.967178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966147+0000","last_change":"2024-03-08T21:34:31.550711+0000","last_active":"2024-03-08T21:34:33.966147+0000","last_peered":"2024-03-08T21:34:33.966147+0000","last_clean":"2024-03-08T21:34:33.966147+0000","last_became_active":"2024-03-08T21:34:31.550387+0000","last_became_peered":"2024-03-08T21:34:31.550387+0000","last_unstale":"2024-03-08T21:34:33.966147+0000","last_undegraded":"2024-03-08T21:34:33.966147+0000","last_fullsized":"2024-03-08T21:34:33.966147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553325+0000","last_change":"2024-03-08T21:34:31.546290+0000","last_active":"2024-03-08T21:34:32.553325+0000","last_peered":"2024-03-08T21:34:32.553325+0000","last_clean":"2024-03-08T21:34:32.553325+0000","last_became_active":"2024-03-08T21:34:31.546033+0000","last_became_peered":"2024-03-08T21:34:31.546033+0000","last_unstale":"2024-03-08T21:34:32.553325+0000","last_undegraded":"2024-03-08T21:34:32.553325+0000","last_fullsized":"2024-03-08T21:34:32.553325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:27:14.540159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554338+0000","last_change":"2024-03-08T21:34:31.559962+0000","last_active":"2024-03-08T21:34:32.554338+0000","last_peered":"2024-03-08T21:34:32.554338+0000","last_clean":"2024-03-08T21:34:32.554338+0000","last_became_active":"2024-03-08T21:34:31.559478+0000","last_became_peered":"2024-03-08T21:34:31.559478+0000","last_unstale":"2024-03-08T21:34:32.554338+0000","last_undegraded":"2024-03-08T21:34:32.554338+0000","last_fullsized":"2024-03-08T21:34:32.554338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.965838+0000","last_change":"2024-03-08T21:34:31.554173+0000","last_active":"2024-03-08T21:34:33.965838+0000","last_peered":"2024-03-08T21:34:33.965838+0000","last_clean":"2024-03-08T21:34:33.965838+0000","last_became_active":"2024-03-08T21:34:31.553870+0000","last_became_peered":"2024-03-08T21:34:31.553870+0000","last_unstale":"2024-03-08T21:34:33.965838+0000","last_undegraded":"2024-03-08T21:34:33.965838+0000","last_fullsized":"2024-03-08T21:34:33.965838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966656+0000","last_change":"2024-03-08T21:34:31.556213+0000","last_active":"2024-03-08T21:34:33.966656+0000","last_peered":"2024-03-08T21:34:33.966656+0000","last_clean":"2024-03-08T21:34:33.966656+0000","last_became_active":"2024-03-08T21:34:31.555630+0000","last_became_peered":"2024-03-08T21:34:31.555630+0000","last_unstale":"2024-03-08T21:34:33.966656+0000","last_undegraded":"2024-03-08T21:34:33.966656+0000","last_fullsized":"2024-03-08T21:34:33.966656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.967178+0000","last_change":"2024-03-08T21:34:31.547267+0000","last_active":"2024-03-08T21:34:33.967178+0000","last_peered":"2024-03-08T21:34:33.967178+0000","last_clean":"2024-03-08T21:34:33.967178+0000","last_became_active":"2024-03-08T21:34:31.547030+0000","last_became_peered":"2024-03-08T21:34:31.547030+0000","last_unstale":"2024-03-08T21:34:33.967178+0000","last_undegraded":"2024-03-08T21:34:33.967178+0000","last_fullsized":"2024-03-08T21:34:33.967178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554962+0000","last_change":"2024-03-08T21:34:31.554196+0000","last_active":"2024-03-08T21:34:32.554962+0000","last_peered":"2024-03-08T21:34:32.554962+0000","last_clean":"2024-03-08T21:34:32.554962+0000","last_became_active":"2024-03-08T21:34:31.553748+0000","last_became_peered":"2024-03-08T21:34:31.553748+0000","last_unstale":"2024-03-08T21:34:32.554962+0000","last_undegraded":"2024-03-08T21:34:32.554962+0000","last_fullsized":"2024-03-08T21:34:32.554962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:25:22.907673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554659+0000","last_change":"2024-03-08T21:34:31.570716+0000","last_active":"2024-03-08T21:34:32.554659+0000","last_peered":"2024-03-08T21:34:32.554659+0000","last_clean":"2024-03-08T21:34:32.554659+0000","last_became_active":"2024-03-08T21:34:31.570352+0000","last_became_peered":"2024-03-08T21:34:31.570352+0000","last_unstale":"2024-03-08T21:34:32.554659+0000","last_undegraded":"2024-03-08T21:34:32.554659+0000","last_fullsized":"2024-03-08T21:34:32.554659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:46.793394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553497+0000","last_change":"2024-03-08T21:34:31.546633+0000","last_active":"2024-03-08T21:34:32.553497+0000","last_peered":"2024-03-08T21:34:32.553497+0000","last_clean":"2024-03-08T21:34:32.553497+0000","last_became_active":"2024-03-08T21:34:31.546360+0000","last_became_peered":"2024-03-08T21:34:31.546360+0000","last_unstale":"2024-03-08T21:34:32.553497+0000","last_undegraded":"2024-03-08T21:34:32.553497+0000","last_fullsized":"2024-03-08T21:34:32.553497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:40.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551505+0000","last_change":"2024-03-08T21:34:31.546993+0000","last_active":"2024-03-08T21:34:32.551505+0000","last_peered":"2024-03-08T21:34:32.551505+0000","last_clean":"2024-03-08T21:34:32.551505+0000","last_became_active":"2024-03-08T21:34:31.546799+0000","last_became_peered":"2024-03-08T21:34:31.546799+0000","last_unstale":"2024-03-08T21:34:32.551505+0000","last_undegraded":"2024-03-08T21:34:32.551505+0000","last_fullsized":"2024-03-08T21:34:32.551505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:14:02.922078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551375+0000","last_change":"2024-03-08T21:34:31.553583+0000","last_active":"2024-03-08T21:34:32.551375+0000","last_peered":"2024-03-08T21:34:32.551375+0000","last_clean":"2024-03-08T21:34:32.551375+0000","last_became_active":"2024-03-08T21:34:31.550846+0000","last_became_peered":"2024-03-08T21:34:31.550846+0000","last_unstale":"2024-03-08T21:34:32.551375+0000","last_undegraded":"2024-03-08T21:34:32.551375+0000","last_fullsized":"2024-03-08T21:34:32.551375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:16:22.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821208+0000","last_change":"2024-03-08T21:34:31.539324+0000","last_active":"2024-03-08T21:34:32.821208+0000","last_peered":"2024-03-08T21:34:32.821208+0000","last_clean":"2024-03-08T21:34:32.821208+0000","last_became_active":"2024-03-08T21:34:31.539046+0000","last_became_peered":"2024-03-08T21:34:31.539046+0000","last_unstale":"2024-03-08T21:34:32.821208+0000","last_undegraded":"2024-03-08T21:34:32.821208+0000","last_fullsized":"2024-03-08T21:34:32.821208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:04.251342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966109+0000","last_change":"2024-03-08T21:34:31.557147+0000","last_active":"2024-03-08T21:34:33.966109+0000","last_peered":"2024-03-08T21:34:33.966109+0000","last_clean":"2024-03-08T21:34:33.966109+0000","last_became_active":"2024-03-08T21:34:31.556879+0000","last_became_peered":"2024-03-08T21:34:31.556879+0000","last_unstale":"2024-03-08T21:34:33.966109+0000","last_undegraded":"2024-03-08T21:34:33.966109+0000","last_fullsized":"2024-03-08T21:34:33.966109+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546366+0000","last_change":"2024-03-08T21:34:31.547201+0000","last_active":"2024-03-08T21:34:33.546366+0000","last_peered":"2024-03-08T21:34:33.546366+0000","last_clean":"2024-03-08T21:34:33.546366+0000","last_became_active":"2024-03-08T21:34:31.545804+0000","last_became_peered":"2024-03-08T21:34:31.545804+0000","last_unstale":"2024-03-08T21:34:33.546366+0000","last_undegraded":"2024-03-08T21:34:33.546366+0000","last_fullsized":"2024-03-08T21:34:33.546366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.555078+0000","last_change":"2024-03-08T21:34:31.553984+0000","last_active":"2024-03-08T21:34:32.555078+0000","last_peered":"2024-03-08T21:34:32.555078+0000","last_clean":"2024-03-08T21:34:32.555078+0000","last_became_active":"2024-03-08T21:34:31.553482+0000","last_became_peered":"2024-03-08T21:34:31.553482+0000","last_unstale":"2024-03-08T21:34:32.555078+0000","last_undegraded":"2024-03-08T21:34:32.555078+0000","last_fullsized":"2024-03-08T21:34:32.555078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:08:20.944549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546216+0000","last_change":"2024-03-08T21:34:31.552703+0000","last_active":"2024-03-08T21:34:33.546216+0000","last_peered":"2024-03-08T21:34:33.546216+0000","last_clean":"2024-03-08T21:34:33.546216+0000","last_became_active":"2024-03-08T21:34:31.552416+0000","last_became_peered":"2024-03-08T21:34:31.552416+0000","last_unstale":"2024-03-08T21:34:33.546216+0000","last_undegraded":"2024-03-08T21:34:33.546216+0000","last_fullsized":"2024-03-08T21:34:33.546216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966253+0000","last_change":"2024-03-08T21:34:31.565192+0000","last_active":"2024-03-08T21:34:33.966253+0000","last_peered":"2024-03-08T21:34:33.966253+0000","last_clean":"2024-03-08T21:34:33.966253+0000","last_became_active":"2024-03-08T21:34:31.564920+0000","last_became_peered":"2024-03-08T21:34:31.564920+0000","last_unstale":"2024-03-08T21:34:33.966253+0000","last_undegraded":"2024-03-08T21:34:33.966253+0000","last_fullsized":"2024-03-08T21:34:33.966253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551485+0000","last_change":"2024-03-08T21:34:31.551813+0000","last_active":"2024-03-08T21:34:32.551485+0000","last_peered":"2024-03-08T21:34:32.551485+0000","last_clean":"2024-03-08T21:34:32.551485+0000","last_became_active":"2024-03-08T21:34:31.551548+0000","last_became_peered":"2024-03-08T21:34:31.551548+0000","last_unstale":"2024-03-08T21:34:32.551485+0000","last_undegraded":"2024-03-08T21:34:32.551485+0000","last_fullsized":"2024-03-08T21:34:32.551485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:20:19.267167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966573+0000","last_change":"2024-03-08T21:34:31.549644+0000","last_active":"2024-03-08T21:34:33.966573+0000","last_peered":"2024-03-08T21:34:33.966573+0000","last_clean":"2024-03-08T21:34:33.966573+0000","last_became_active":"2024-03-08T21:34:31.549334+0000","last_became_peered":"2024-03-08T21:34:31.549334+0000","last_unstale":"2024-03-08T21:34:33.966573+0000","last_undegraded":"2024-03-08T21:34:33.966573+0000","last_fullsized":"2024-03-08T21:34:33.966573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453096+0000","last_change":"2024-03-08T21:34:31.552011+0000","last_active":"2024-03-08T21:34:33.453096+0000","last_peered":"2024-03-08T21:34:33.453096+0000","last_clean":"2024-03-08T21:34:33.453096+0000","last_became_active":"2024-03-08T21:34:31.551719+0000","last_became_peered":"2024-03-08T21:34:31.551719+0000","last_unstale":"2024-03-08T21:34:33.453096+0000","last_undegraded":"2024-03-08T21:34:33.453096+0000","last_fullsized":"2024-03-08T21:34:33.453096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:13:37.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966191+0000","last_change":"2024-03-08T21:34:31.541777+0000","last_active":"2024-03-08T21:34:33.966191+0000","last_peered":"2024-03-08T21:34:33.966191+0000","last_clean":"2024-03-08T21:34:33.966191+0000","last_became_active":"2024-03-08T21:34:31.541486+0000","last_became_peered":"2024-03-08T21:34:31.541486+0000","last_unstale":"2024-03-08T21:34:33.966191+0000","last_undegraded":"2024-03-08T21:34:33.966191+0000","last_fullsized":"2024-03-08T21:34:33.966191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:48:23.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821385+0000","last_change":"2024-03-08T21:34:31.544651+0000","last_active":"2024-03-08T21:34:32.821385+0000","last_peered":"2024-03-08T21:34:32.821385+0000","last_clean":"2024-03-08T21:34:32.821385+0000","last_became_active":"2024-03-08T21:34:31.544360+0000","last_became_peered":"2024-03-08T21:34:31.544360+0000","last_unstale":"2024-03-08T21:34:32.821385+0000","last_undegraded":"2024-03-08T21:34:32.821385+0000","last_fullsized":"2024-03-08T21:34:32.821385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:35:19.289201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453217+0000","last_change":"2024-03-08T21:34:30.554739+0000","last_active":"2024-03-08T21:34:33.453217+0000","last_peered":"2024-03-08T21:34:33.453217+0000","last_clean":"2024-03-08T21:34:33.453217+0000","last_became_active":"2024-03-08T21:34:30.554507+0000","last_became_peered":"2024-03-08T21:34:30.554507+0000","last_unstale":"2024-03-08T21:34:33.453217+0000","last_undegraded":"2024-03-08T21:34:33.453217+0000","last_fullsized":"2024-03-08T21:34:33.453217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:20:21.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453202+0000","last_change":"2024-03-08T21:34:31.556398+0000","last_active":"2024-03-08T21:34:33.453202+0000","last_peered":"2024-03-08T21:34:33.453202+0000","last_clean":"2024-03-08T21:34:33.453202+0000","last_became_active":"2024-03-08T21:34:31.555986+0000","last_became_peered":"2024-03-08T21:34:31.555986+0000","last_unstale":"2024-03-08T21:34:33.453202+0000","last_undegraded":"2024-03-08T21:34:33.453202+0000","last_fullsized":"2024-03-08T21:34:33.453202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:58:53.572351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821304+0000","last_change":"2024-03-08T21:34:30.552607+0000","last_active":"2024-03-08T21:34:32.821304+0000","last_peered":"2024-03-08T21:34:32.821304+0000","last_clean":"2024-03-08T21:34:32.821304+0000","last_became_active":"2024-03-08T21:34:30.552276+0000","last_became_peered":"2024-03-08T21:34:30.552276+0000","last_unstale":"2024-03-08T21:34:32.821304+0000","last_undegraded":"2024-03-08T21:34:32.821304+0000","last_fullsized":"2024-03-08T21:34:32.821304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:28:58.375670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551168+0000","last_change":"2024-03-08T21:34:31.554706+0000","last_active":"2024-03-08T21:34:32.551168+0000","last_peered":"2024-03-08T21:34:32.551168+0000","last_clean":"2024-03-08T21:34:32.551168+0000","last_became_active":"2024-03-08T21:34:31.552133+0000","last_became_peered":"2024-03-08T21:34:31.552133+0000","last_unstale":"2024-03-08T21:34:32.551168+0000","last_undegraded":"2024-03-08T21:34:32.551168+0000","last_fullsized":"2024-03-08T21:34:32.551168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:35:19.289201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554595+0000","last_change":"2024-03-08T21:34:30.556124+0000","last_active":"2024-03-08T21:34:32.554595+0000","last_peered":"2024-03-08T21:34:32.554595+0000","last_clean":"2024-03-08T21:34:32.554595+0000","last_became_active":"2024-03-08T21:34:30.554853+0000","last_became_peered":"2024-03-08T21:34:30.554853+0000","last_unstale":"2024-03-08T21:34:32.554595+0000","last_undegraded":"2024-03-08T21:34:32.554595+0000","last_fullsized":"2024-03-08T21:34:32.554595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:51:52.543554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546279+0000","last_change":"2024-03-08T21:34:31.558187+0000","last_active":"2024-03-08T21:34:33.546279+0000","last_peered":"2024-03-08T21:34:33.546279+0000","last_clean":"2024-03-08T21:34:33.546279+0000","last_became_active":"2024-03-08T21:34:31.557876+0000","last_became_peered":"2024-03-08T21:34:31.557876+0000","last_unstale":"2024-03-08T21:34:33.546279+0000","last_undegraded":"2024-03-08T21:34:33.546279+0000","last_fullsized":"2024-03-08T21:34:33.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553474+0000","last_change":"2024-03-08T21:34:30.560868+0000","last_active":"2024-03-08T21:34:32.553474+0000","last_peered":"2024-03-08T21:34:32.553474+0000","last_clean":"2024-03-08T21:34:32.553474+0000","last_became_active":"2024-03-08T21:34:30.560595+0000","last_became_peered":"2024-03-08T21:34:30.560595+0000","last_unstale":"2024-03-08T21:34:32.553474+0000","last_undegraded":"2024-03-08T21:34:32.553474+0000","last_fullsized":"2024-03-08T21:34:32.553474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:46:04.154633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966742+0000","last_change":"2024-03-08T21:34:31.545948+0000","last_active":"2024-03-08T21:34:33.966742+0000","last_peered":"2024-03-08T21:34:33.966742+0000","last_clean":"2024-03-08T21:34:33.966742+0000","last_became_active":"2024-03-08T21:34:31.545650+0000","last_became_peered":"2024-03-08T21:34:31.545650+0000","last_unstale":"2024-03-08T21:34:33.966742+0000","last_undegraded":"2024-03-08T21:34:33.966742+0000","last_fullsized":"2024-03-08T21:34:33.966742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551615+0000","last_change":"2024-03-08T21:34:30.550115+0000","last_active":"2024-03-08T21:34:32.551615+0000","last_peered":"2024-03-08T21:34:32.551615+0000","last_clean":"2024-03-08T21:34:32.551615+0000","last_became_active":"2024-03-08T21:34:30.549841+0000","last_became_peered":"2024-03-08T21:34:30.549841+0000","last_unstale":"2024-03-08T21:34:32.551615+0000","last_undegraded":"2024-03-08T21:34:32.551615+0000","last_fullsized":"2024-03-08T21:34:32.551615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:52:11.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966056+0000","last_change":"2024-03-08T21:34:31.562306+0000","last_active":"2024-03-08T21:34:33.966056+0000","last_peered":"2024-03-08T21:34:33.966056+0000","last_clean":"2024-03-08T21:34:33.966056+0000","last_became_active":"2024-03-08T21:34:31.562033+0000","last_became_peered":"2024-03-08T21:34:31.562033+0000","last_unstale":"2024-03-08T21:34:33.966056+0000","last_undegraded":"2024-03-08T21:34:33.966056+0000","last_fullsized":"2024-03-08T21:34:33.966056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551366+0000","last_change":"2024-03-08T21:34:30.545293+0000","last_active":"2024-03-08T21:34:32.551366+0000","last_peered":"2024-03-08T21:34:32.551366+0000","last_clean":"2024-03-08T21:34:32.551366+0000","last_became_active":"2024-03-08T21:34:30.544985+0000","last_became_peered":"2024-03-08T21:34:30.544985+0000","last_unstale":"2024-03-08T21:34:32.551366+0000","last_undegraded":"2024-03-08T21:34:32.551366+0000","last_fullsized":"2024-03-08T21:34:32.551366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:05:20.453770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550847+0000","last_change":"2024-03-08T21:34:31.557748+0000","last_active":"2024-03-08T21:34:32.550847+0000","last_peered":"2024-03-08T21:34:32.550847+0000","last_clean":"2024-03-08T21:34:32.550847+0000","last_became_active":"2024-03-08T21:34:31.549115+0000","last_became_peered":"2024-03-08T21:34:31.549115+0000","last_unstale":"2024-03-08T21:34:32.550847+0000","last_undegraded":"2024-03-08T21:34:32.550847+0000","last_fullsized":"2024-03-08T21:34:32.550847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:04.251342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553907+0000","last_change":"2024-03-08T21:34:30.546435+0000","last_active":"2024-03-08T21:34:32.553907+0000","last_peered":"2024-03-08T21:34:32.553907+0000","last_clean":"2024-03-08T21:34:32.553907+0000","last_became_active":"2024-03-08T21:34:30.546147+0000","last_became_peered":"2024-03-08T21:34:30.546147+0000","last_unstale":"2024-03-08T21:34:32.553907+0000","last_undegraded":"2024-03-08T21:34:32.553907+0000","last_fullsized":"2024-03-08T21:34:32.553907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:33.669073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545708+0000","last_change":"2024-03-08T21:34:31.543843+0000","last_active":"2024-03-08T21:34:33.545708+0000","last_peered":"2024-03-08T21:34:33.545708+0000","last_clean":"2024-03-08T21:34:33.545708+0000","last_became_active":"2024-03-08T21:34:31.543545+0000","last_became_peered":"2024-03-08T21:34:31.543545+0000","last_unstale":"2024-03-08T21:34:33.545708+0000","last_undegraded":"2024-03-08T21:34:33.545708+0000","last_fullsized":"2024-03-08T21:34:33.545708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:21:55.608760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550786+0000","last_change":"2024-03-08T21:34:30.546979+0000","last_active":"2024-03-08T21:34:32.550786+0000","last_peered":"2024-03-08T21:34:32.550786+0000","last_clean":"2024-03-08T21:34:32.550786+0000","last_became_active":"2024-03-08T21:34:30.546662+0000","last_became_peered":"2024-03-08T21:34:30.546662+0000","last_unstale":"2024-03-08T21:34:32.550786+0000","last_undegraded":"2024-03-08T21:34:32.550786+0000","last_fullsized":"2024-03-08T21:34:32.550786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:54:59.925309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966553+0000","last_change":"2024-03-08T21:34:31.560602+0000","last_active":"2024-03-08T21:34:33.966553+0000","last_peered":"2024-03-08T21:34:33.966553+0000","last_clean":"2024-03-08T21:34:33.966553+0000","last_became_active":"2024-03-08T21:34:31.560360+0000","last_became_peered":"2024-03-08T21:34:31.560360+0000","last_unstale":"2024-03-08T21:34:33.966553+0000","last_undegraded":"2024-03-08T21:34:33.966553+0000","last_fullsized":"2024-03-08T21:34:33.966553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554876+0000","last_change":"2024-03-08T21:34:30.543584+0000","last_active":"2024-03-08T21:34:32.554876+0000","last_peered":"2024-03-08T21:34:32.554876+0000","last_clean":"2024-03-08T21:34:32.554876+0000","last_became_active":"2024-03-08T21:34:30.543318+0000","last_became_peered":"2024-03-08T21:34:30.543318+0000","last_unstale":"2024-03-08T21:34:32.554876+0000","last_undegraded":"2024-03-08T21:34:32.554876+0000","last_fullsized":"2024-03-08T21:34:32.554876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:58:52.563049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554948+0000","last_change":"2024-03-08T21:34:31.570551+0000","last_active":"2024-03-08T21:34:32.554948+0000","last_peered":"2024-03-08T21:34:32.554948+0000","last_clean":"2024-03-08T21:34:32.554948+0000","last_became_active":"2024-03-08T21:34:31.569930+0000","last_became_peered":"2024-03-08T21:34:31.569930+0000","last_unstale":"2024-03-08T21:34:32.554948+0000","last_undegraded":"2024-03-08T21:34:32.554948+0000","last_fullsized":"2024-03-08T21:34:32.554948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:33:26.012222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821421+0000","last_change":"2024-03-08T21:34:30.552003+0000","last_active":"2024-03-08T21:34:32.821421+0000","last_peered":"2024-03-08T21:34:32.821421+0000","last_clean":"2024-03-08T21:34:32.821421+0000","last_became_active":"2024-03-08T21:34:30.551696+0000","last_became_peered":"2024-03-08T21:34:30.551696+0000","last_unstale":"2024-03-08T21:34:32.821421+0000","last_undegraded":"2024-03-08T21:34:32.821421+0000","last_fullsized":"2024-03-08T21:34:32.821421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:03:05.385139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554682+0000","last_change":"2024-03-08T21:34:31.548911+0000","last_active":"2024-03-08T21:34:32.554682+0000","last_peered":"2024-03-08T21:34:32.554682+0000","last_clean":"2024-03-08T21:34:32.554682+0000","last_became_active":"2024-03-08T21:34:31.548576+0000","last_became_peered":"2024-03-08T21:34:31.548576+0000","last_unstale":"2024-03-08T21:34:32.554682+0000","last_undegraded":"2024-03-08T21:34:32.554682+0000","last_fullsized":"2024-03-08T21:34:32.554682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:09:34.397830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966428+0000","last_change":"2024-03-08T21:34:30.550186+0000","last_active":"2024-03-08T21:34:33.966428+0000","last_peered":"2024-03-08T21:34:33.966428+0000","last_clean":"2024-03-08T21:34:33.966428+0000","last_became_active":"2024-03-08T21:34:30.548951+0000","last_became_peered":"2024-03-08T21:34:30.548951+0000","last_unstale":"2024-03-08T21:34:33.966428+0000","last_undegraded":"2024-03-08T21:34:33.966428+0000","last_fullsized":"2024-03-08T21:34:33.966428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966262+0000","last_change":"2024-03-08T21:34:31.559327+0000","last_active":"2024-03-08T21:34:33.966262+0000","last_peered":"2024-03-08T21:34:33.966262+0000","last_clean":"2024-03-08T21:34:33.966262+0000","last_became_active":"2024-03-08T21:34:31.558932+0000","last_became_peered":"2024-03-08T21:34:31.558932+0000","last_unstale":"2024-03-08T21:34:33.966262+0000","last_undegraded":"2024-03-08T21:34:33.966262+0000","last_fullsized":"2024-03-08T21:34:33.966262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554613+0000","last_change":"2024-03-08T21:34:30.556419+0000","last_active":"2024-03-08T21:34:32.554613+0000","last_peered":"2024-03-08T21:34:32.554613+0000","last_clean":"2024-03-08T21:34:32.554613+0000","last_became_active":"2024-03-08T21:34:30.556144+0000","last_became_peered":"2024-03-08T21:34:30.556144+0000","last_unstale":"2024-03-08T21:34:32.554613+0000","last_undegraded":"2024-03-08T21:34:32.554613+0000","last_fullsized":"2024-03-08T21:34:32.554613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:13:36.585185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545719+0000","last_change":"2024-03-08T21:34:31.543818+0000","last_active":"2024-03-08T21:34:33.545719+0000","last_peered":"2024-03-08T21:34:33.545719+0000","last_clean":"2024-03-08T21:34:33.545719+0000","last_became_active":"2024-03-08T21:34:31.543483+0000","last_became_peered":"2024-03-08T21:34:31.543483+0000","last_unstale":"2024-03-08T21:34:33.545719+0000","last_undegraded":"2024-03-08T21:34:33.545719+0000","last_fullsized":"2024-03-08T21:34:33.545719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:28.216676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551616+0000","last_change":"2024-03-08T21:34:30.550329+0000","last_active":"2024-03-08T21:34:32.551616+0000","last_peered":"2024-03-08T21:34:32.551616+0000","last_clean":"2024-03-08T21:34:32.551616+0000","last_became_active":"2024-03-08T21:34:30.549320+0000","last_became_peered":"2024-03-08T21:34:30.549320+0000","last_unstale":"2024-03-08T21:34:32.551616+0000","last_undegraded":"2024-03-08T21:34:32.551616+0000","last_fullsized":"2024-03-08T21:34:32.551616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:04:48.901291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554583+0000","last_change":"2024-03-08T21:34:31.560917+0000","last_active":"2024-03-08T21:34:32.554583+0000","last_peered":"2024-03-08T21:34:32.554583+0000","last_clean":"2024-03-08T21:34:32.554583+0000","last_became_active":"2024-03-08T21:34:31.560666+0000","last_became_peered":"2024-03-08T21:34:31.560666+0000","last_unstale":"2024-03-08T21:34:32.554583+0000","last_undegraded":"2024-03-08T21:34:32.554583+0000","last_fullsized":"2024-03-08T21:34:32.554583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545706+0000","last_change":"2024-03-08T21:34:30.553209+0000","last_active":"2024-03-08T21:34:33.545706+0000","last_peered":"2024-03-08T21:34:33.545706+0000","last_clean":"2024-03-08T21:34:33.545706+0000","last_became_active":"2024-03-08T21:34:30.552968+0000","last_became_peered":"2024-03-08T21:34:30.552968+0000","last_unstale":"2024-03-08T21:34:33.545706+0000","last_undegraded":"2024-03-08T21:34:33.545706+0000","last_fullsized":"2024-03-08T21:34:33.545706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:39.894974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966229+0000","last_change":"2024-03-08T21:34:31.556449+0000","last_active":"2024-03-08T21:34:33.966229+0000","last_peered":"2024-03-08T21:34:33.966229+0000","last_clean":"2024-03-08T21:34:33.966229+0000","last_became_active":"2024-03-08T21:34:31.555944+0000","last_became_peered":"2024-03-08T21:34:31.555944+0000","last_unstale":"2024-03-08T21:34:33.966229+0000","last_undegraded":"2024-03-08T21:34:33.966229+0000","last_fullsized":"2024-03-08T21:34:33.966229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553934+0000","last_change":"2024-03-08T21:34:30.544575+0000","last_active":"2024-03-08T21:34:32.553934+0000","last_peered":"2024-03-08T21:34:32.553934+0000","last_clean":"2024-03-08T21:34:32.553934+0000","last_became_active":"2024-03-08T21:34:30.544164+0000","last_became_peered":"2024-03-08T21:34:30.544164+0000","last_unstale":"2024-03-08T21:34:32.553934+0000","last_undegraded":"2024-03-08T21:34:32.553934+0000","last_fullsized":"2024-03-08T21:34:32.553934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:20:26.256691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453066+0000","last_change":"2024-03-08T21:34:31.558954+0000","last_active":"2024-03-08T21:34:33.453066+0000","last_peered":"2024-03-08T21:34:33.453066+0000","last_clean":"2024-03-08T21:34:33.453066+0000","last_became_active":"2024-03-08T21:34:31.558702+0000","last_became_peered":"2024-03-08T21:34:31.558702+0000","last_unstale":"2024-03-08T21:34:33.453066+0000","last_undegraded":"2024-03-08T21:34:33.453066+0000","last_fullsized":"2024-03-08T21:34:33.453066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:20:27.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553918+0000","last_change":"2024-03-08T21:34:30.547624+0000","last_active":"2024-03-08T21:34:32.553918+0000","last_peered":"2024-03-08T21:34:32.553918+0000","last_clean":"2024-03-08T21:34:32.553918+0000","last_became_active":"2024-03-08T21:34:30.547323+0000","last_became_peered":"2024-03-08T21:34:30.547323+0000","last_unstale":"2024-03-08T21:34:32.553918+0000","last_undegraded":"2024-03-08T21:34:32.553918+0000","last_fullsized":"2024-03-08T21:34:32.553918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551043+0000","last_change":"2024-03-08T21:34:31.556373+0000","last_active":"2024-03-08T21:34:32.551043+0000","last_peered":"2024-03-08T21:34:32.551043+0000","last_clean":"2024-03-08T21:34:32.551043+0000","last_became_active":"2024-03-08T21:34:31.552758+0000","last_became_peered":"2024-03-08T21:34:31.552758+0000","last_unstale":"2024-03-08T21:34:32.551043+0000","last_undegraded":"2024-03-08T21:34:32.551043+0000","last_fullsized":"2024-03-08T21:34:32.551043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:06:54.847854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546398+0000","last_change":"2024-03-08T21:34:30.556652+0000","last_active":"2024-03-08T21:34:33.546398+0000","last_peered":"2024-03-08T21:34:33.546398+0000","last_clean":"2024-03-08T21:34:33.546398+0000","last_became_active":"2024-03-08T21:34:30.555919+0000","last_became_peered":"2024-03-08T21:34:30.555919+0000","last_unstale":"2024-03-08T21:34:33.546398+0000","last_undegraded":"2024-03-08T21:34:33.546398+0000","last_fullsized":"2024-03-08T21:34:33.546398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:39.936700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966772+0000","last_change":"2024-03-08T21:34:31.556923+0000","last_active":"2024-03-08T21:34:33.966772+0000","last_peered":"2024-03-08T21:34:33.966772+0000","last_clean":"2024-03-08T21:34:33.966772+0000","last_became_active":"2024-03-08T21:34:31.556657+0000","last_became_peered":"2024-03-08T21:34:31.556657+0000","last_unstale":"2024-03-08T21:34:33.966772+0000","last_undegraded":"2024-03-08T21:34:33.966772+0000","last_fullsized":"2024-03-08T21:34:33.966772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551370+0000","last_change":"2024-03-08T21:34:30.549334+0000","last_active":"2024-03-08T21:34:32.551370+0000","last_peered":"2024-03-08T21:34:32.551370+0000","last_clean":"2024-03-08T21:34:32.551370+0000","last_became_active":"2024-03-08T21:34:30.549045+0000","last_became_peered":"2024-03-08T21:34:30.549045+0000","last_unstale":"2024-03-08T21:34:32.551370+0000","last_undegraded":"2024-03-08T21:34:32.551370+0000","last_fullsized":"2024-03-08T21:34:32.551370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:23:44.306090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545995+0000","last_change":"2024-03-08T21:34:31.552410+0000","last_active":"2024-03-08T21:34:33.545995+0000","last_peered":"2024-03-08T21:34:33.545995+0000","last_clean":"2024-03-08T21:34:33.545995+0000","last_became_active":"2024-03-08T21:34:31.552145+0000","last_became_peered":"2024-03-08T21:34:31.552145+0000","last_unstale":"2024-03-08T21:34:33.545995+0000","last_undegraded":"2024-03-08T21:34:33.545995+0000","last_fullsized":"2024-03-08T21:34:33.545995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551216+0000","last_change":"2024-03-08T21:34:30.551684+0000","last_active":"2024-03-08T21:34:32.551216+0000","last_peered":"2024-03-08T21:34:32.551216+0000","last_clean":"2024-03-08T21:34:32.551216+0000","last_became_active":"2024-03-08T21:34:30.550864+0000","last_became_peered":"2024-03-08T21:34:30.550864+0000","last_unstale":"2024-03-08T21:34:32.551216+0000","last_undegraded":"2024-03-08T21:34:32.551216+0000","last_fullsized":"2024-03-08T21:34:32.551216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:04:21.543617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553471+0000","last_change":"2024-03-08T21:34:31.545726+0000","last_active":"2024-03-08T21:34:32.553471+0000","last_peered":"2024-03-08T21:34:32.553471+0000","last_clean":"2024-03-08T21:34:32.553471+0000","last_became_active":"2024-03-08T21:34:31.545457+0000","last_became_peered":"2024-03-08T21:34:31.545457+0000","last_unstale":"2024-03-08T21:34:32.553471+0000","last_undegraded":"2024-03-08T21:34:32.553471+0000","last_fullsized":"2024-03-08T21:34:32.553471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:50:19.029413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551295+0000","last_change":"2024-03-08T21:34:30.550579+0000","last_active":"2024-03-08T21:34:32.551295+0000","last_peered":"2024-03-08T21:34:32.551295+0000","last_clean":"2024-03-08T21:34:32.551295+0000","last_became_active":"2024-03-08T21:34:30.550209+0000","last_became_peered":"2024-03-08T21:34:30.550209+0000","last_unstale":"2024-03-08T21:34:32.551295+0000","last_undegraded":"2024-03-08T21:34:32.551295+0000","last_fullsized":"2024-03-08T21:34:32.551295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:08.440051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553267+0000","last_change":"2024-03-08T21:34:31.556322+0000","last_active":"2024-03-08T21:34:32.553267+0000","last_peered":"2024-03-08T21:34:32.553267+0000","last_clean":"2024-03-08T21:34:32.553267+0000","last_became_active":"2024-03-08T21:34:31.555984+0000","last_became_peered":"2024-03-08T21:34:31.555984+0000","last_unstale":"2024-03-08T21:34:32.553267+0000","last_undegraded":"2024-03-08T21:34:32.553267+0000","last_fullsized":"2024-03-08T21:34:32.553267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:33:47.839788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821324+0000","last_change":"2024-03-08T21:34:30.560190+0000","last_active":"2024-03-08T21:34:32.821324+0000","last_peered":"2024-03-08T21:34:32.821324+0000","last_clean":"2024-03-08T21:34:32.821324+0000","last_became_active":"2024-03-08T21:34:30.559913+0000","last_became_peered":"2024-03-08T21:34:30.559913+0000","last_unstale":"2024-03-08T21:34:32.821324+0000","last_undegraded":"2024-03-08T21:34:32.821324+0000","last_fullsized":"2024-03-08T21:34:32.821324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:23:44.306090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553487+0000","last_change":"2024-03-08T21:34:31.567893+0000","last_active":"2024-03-08T21:34:32.553487+0000","last_peered":"2024-03-08T21:34:32.553487+0000","last_clean":"2024-03-08T21:34:32.553487+0000","last_became_active":"2024-03-08T21:34:31.567686+0000","last_became_peered":"2024-03-08T21:34:31.567686+0000","last_unstale":"2024-03-08T21:34:32.553487+0000","last_undegraded":"2024-03-08T21:34:32.553487+0000","last_fullsized":"2024-03-08T21:34:32.553487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:29:01.664278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453072+0000","last_change":"2024-03-08T21:34:30.558965+0000","last_active":"2024-03-08T21:34:33.453072+0000","last_peered":"2024-03-08T21:34:33.453072+0000","last_clean":"2024-03-08T21:34:33.453072+0000","last_became_active":"2024-03-08T21:34:30.558733+0000","last_became_peered":"2024-03-08T21:34:30.558733+0000","last_unstale":"2024-03-08T21:34:33.453072+0000","last_undegraded":"2024-03-08T21:34:33.453072+0000","last_fullsized":"2024-03-08T21:34:33.453072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:39.894974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553126+0000","last_change":"2024-03-08T21:34:31.569142+0000","last_active":"2024-03-08T21:34:32.553126+0000","last_peered":"2024-03-08T21:34:32.553126+0000","last_clean":"2024-03-08T21:34:32.553126+0000","last_became_active":"2024-03-08T21:34:31.568593+0000","last_became_peered":"2024-03-08T21:34:31.568593+0000","last_unstale":"2024-03-08T21:34:32.553126+0000","last_undegraded":"2024-03-08T21:34:32.553126+0000","last_fullsized":"2024-03-08T21:34:32.553126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:16.910508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550865+0000","last_change":"2024-03-08T21:34:30.550256+0000","last_active":"2024-03-08T21:34:32.550865+0000","last_peered":"2024-03-08T21:34:32.550865+0000","last_clean":"2024-03-08T21:34:32.550865+0000","last_became_active":"2024-03-08T21:34:30.549932+0000","last_became_peered":"2024-03-08T21:34:30.549932+0000","last_unstale":"2024-03-08T21:34:32.550865+0000","last_undegraded":"2024-03-08T21:34:32.550865+0000","last_fullsized":"2024-03-08T21:34:32.550865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:23:04.872100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966713+0000","last_change":"2024-03-08T21:34:31.555063+0000","last_active":"2024-03-08T21:34:33.966713+0000","last_peered":"2024-03-08T21:34:33.966713+0000","last_clean":"2024-03-08T21:34:33.966713+0000","last_became_active":"2024-03-08T21:34:31.554685+0000","last_became_peered":"2024-03-08T21:34:31.554685+0000","last_unstale":"2024-03-08T21:34:33.966713+0000","last_undegraded":"2024-03-08T21:34:33.966713+0000","last_fullsized":"2024-03-08T21:34:33.966713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.965673+0000","last_change":"2024-03-08T21:34:30.543567+0000","last_active":"2024-03-08T21:34:33.965673+0000","last_peered":"2024-03-08T21:34:33.965673+0000","last_clean":"2024-03-08T21:34:33.965673+0000","last_became_active":"2024-03-08T21:34:30.543129+0000","last_became_peered":"2024-03-08T21:34:30.543129+0000","last_unstale":"2024-03-08T21:34:33.965673+0000","last_undegraded":"2024-03-08T21:34:33.965673+0000","last_fullsized":"2024-03-08T21:34:33.965673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.238862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553411+0000","last_change":"2024-03-08T21:34:31.549004+0000","last_active":"2024-03-08T21:34:32.553411+0000","last_peered":"2024-03-08T21:34:32.553411+0000","last_clean":"2024-03-08T21:34:32.553411+0000","last_became_active":"2024-03-08T21:34:31.548739+0000","last_became_peered":"2024-03-08T21:34:31.548739+0000","last_unstale":"2024-03-08T21:34:32.553411+0000","last_undegraded":"2024-03-08T21:34:32.553411+0000","last_fullsized":"2024-03-08T21:34:32.553411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:23:09.738399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546418+0000","last_change":"2024-03-08T21:34:30.554333+0000","last_active":"2024-03-08T21:34:33.546418+0000","last_peered":"2024-03-08T21:34:33.546418+0000","last_clean":"2024-03-08T21:34:33.546418+0000","last_became_active":"2024-03-08T21:34:30.554055+0000","last_became_peered":"2024-03-08T21:34:30.554055+0000","last_unstale":"2024-03-08T21:34:33.546418+0000","last_undegraded":"2024-03-08T21:34:33.546418+0000","last_fullsized":"2024-03-08T21:34:33.546418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966890+0000","last_change":"2024-03-08T21:34:31.548419+0000","last_active":"2024-03-08T21:34:33.966890+0000","last_peered":"2024-03-08T21:34:33.966890+0000","last_clean":"2024-03-08T21:34:33.966890+0000","last_became_active":"2024-03-08T21:34:31.547838+0000","last_became_peered":"2024-03-08T21:34:31.547838+0000","last_unstale":"2024-03-08T21:34:33.966890+0000","last_undegraded":"2024-03-08T21:34:33.966890+0000","last_fullsized":"2024-03-08T21:34:33.966890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:46.793394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.544956+0000","last_change":"2024-03-08T21:34:30.558750+0000","last_active":"2024-03-08T21:34:33.544956+0000","last_peered":"2024-03-08T21:34:33.544956+0000","last_clean":"2024-03-08T21:34:33.544956+0000","last_became_active":"2024-03-08T21:34:30.558445+0000","last_became_peered":"2024-03-08T21:34:30.558445+0000","last_unstale":"2024-03-08T21:34:33.544956+0000","last_undegraded":"2024-03-08T21:34:33.544956+0000","last_fullsized":"2024-03-08T21:34:33.544956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:31:03.113547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821300+0000","last_change":"2024-03-08T21:34:31.550510+0000","last_active":"2024-03-08T21:34:32.821300+0000","last_peered":"2024-03-08T21:34:32.821300+0000","last_clean":"2024-03-08T21:34:32.821300+0000","last_became_active":"2024-03-08T21:34:31.550201+0000","last_became_peered":"2024-03-08T21:34:31.550201+0000","last_unstale":"2024-03-08T21:34:32.821300+0000","last_undegraded":"2024-03-08T21:34:32.821300+0000","last_fullsized":"2024-03-08T21:34:32.821300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:45:45.812558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546063+0000","last_change":"2024-03-08T21:34:30.556754+0000","last_active":"2024-03-08T21:34:33.546063+0000","last_peered":"2024-03-08T21:34:33.546063+0000","last_clean":"2024-03-08T21:34:33.546063+0000","last_became_active":"2024-03-08T21:34:30.556424+0000","last_became_peered":"2024-03-08T21:34:30.556424+0000","last_unstale":"2024-03-08T21:34:33.546063+0000","last_undegraded":"2024-03-08T21:34:33.546063+0000","last_fullsized":"2024-03-08T21:34:33.546063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:07:49.087025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453148+0000","last_change":"2024-03-08T21:34:31.562018+0000","last_active":"2024-03-08T21:34:33.453148+0000","last_peered":"2024-03-08T21:34:33.453148+0000","last_clean":"2024-03-08T21:34:33.453148+0000","last_became_active":"2024-03-08T21:34:31.561769+0000","last_became_peered":"2024-03-08T21:34:31.561769+0000","last_unstale":"2024-03-08T21:34:33.453148+0000","last_undegraded":"2024-03-08T21:34:33.453148+0000","last_fullsized":"2024-03-08T21:34:33.453148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:09:45.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821444+0000","last_change":"2024-03-08T21:34:30.552076+0000","last_active":"2024-03-08T21:34:32.821444+0000","last_peered":"2024-03-08T21:34:32.821444+0000","last_clean":"2024-03-08T21:34:32.821444+0000","last_became_active":"2024-03-08T21:34:30.551683+0000","last_became_peered":"2024-03-08T21:34:30.551683+0000","last_unstale":"2024-03-08T21:34:32.821444+0000","last_undegraded":"2024-03-08T21:34:32.821444+0000","last_fullsized":"2024-03-08T21:34:32.821444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:49.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821387+0000","last_change":"2024-03-08T21:34:31.558159+0000","last_active":"2024-03-08T21:34:32.821387+0000","last_peered":"2024-03-08T21:34:32.821387+0000","last_clean":"2024-03-08T21:34:32.821387+0000","last_became_active":"2024-03-08T21:34:31.557912+0000","last_became_peered":"2024-03-08T21:34:31.557912+0000","last_unstale":"2024-03-08T21:34:32.821387+0000","last_undegraded":"2024-03-08T21:34:32.821387+0000","last_fullsized":"2024-03-08T21:34:32.821387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:06:54.847854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545803+0000","last_change":"2024-03-08T21:34:30.546866+0000","last_active":"2024-03-08T21:34:33.545803+0000","last_peered":"2024-03-08T21:34:33.545803+0000","last_clean":"2024-03-08T21:34:33.545803+0000","last_became_active":"2024-03-08T21:34:30.546612+0000","last_became_peered":"2024-03-08T21:34:30.546612+0000","last_unstale":"2024-03-08T21:34:33.545803+0000","last_undegraded":"2024-03-08T21:34:33.545803+0000","last_fullsized":"2024-03-08T21:34:33.545803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:20:21.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554075+0000","last_change":"2024-03-08T21:34:31.551536+0000","last_active":"2024-03-08T21:34:32.554075+0000","last_peered":"2024-03-08T21:34:32.554075+0000","last_clean":"2024-03-08T21:34:32.554075+0000","last_became_active":"2024-03-08T21:34:31.551080+0000","last_became_peered":"2024-03-08T21:34:31.551080+0000","last_unstale":"2024-03-08T21:34:32.554075+0000","last_undegraded":"2024-03-08T21:34:32.554075+0000","last_fullsized":"2024-03-08T21:34:32.554075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551341+0000","last_change":"2024-03-08T21:34:30.545077+0000","last_active":"2024-03-08T21:34:32.551341+0000","last_peered":"2024-03-08T21:34:32.551341+0000","last_clean":"2024-03-08T21:34:32.551341+0000","last_became_active":"2024-03-08T21:34:30.544704+0000","last_became_peered":"2024-03-08T21:34:30.544704+0000","last_unstale":"2024-03-08T21:34:32.551341+0000","last_undegraded":"2024-03-08T21:34:32.551341+0000","last_fullsized":"2024-03-08T21:34:32.551341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:39:52.000503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550868+0000","last_change":"2024-03-08T21:34:31.558028+0000","last_active":"2024-03-08T21:34:32.550868+0000","last_peered":"2024-03-08T21:34:32.550868+0000","last_clean":"2024-03-08T21:34:32.550868+0000","last_became_active":"2024-03-08T21:34:31.551210+0000","last_became_peered":"2024-03-08T21:34:31.551210+0000","last_unstale":"2024-03-08T21:34:32.550868+0000","last_undegraded":"2024-03-08T21:34:32.550868+0000","last_fullsized":"2024-03-08T21:34:32.550868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:45:45.812558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554018+0000","last_change":"2024-03-08T21:34:30.541268+0000","last_active":"2024-03-08T21:34:32.554018+0000","last_peered":"2024-03-08T21:34:32.554018+0000","last_clean":"2024-03-08T21:34:32.554018+0000","last_became_active":"2024-03-08T21:34:30.541005+0000","last_became_peered":"2024-03-08T21:34:30.541005+0000","last_unstale":"2024-03-08T21:34:32.554018+0000","last_undegraded":"2024-03-08T21:34:32.554018+0000","last_fullsized":"2024-03-08T21:34:32.554018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.238862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966829+0000","last_change":"2024-03-08T21:34:31.552002+0000","last_active":"2024-03-08T21:34:33.966829+0000","last_peered":"2024-03-08T21:34:33.966829+0000","last_clean":"2024-03-08T21:34:33.966829+0000","last_became_active":"2024-03-08T21:34:31.551710+0000","last_became_peered":"2024-03-08T21:34:31.551710+0000","last_unstale":"2024-03-08T21:34:33.966829+0000","last_undegraded":"2024-03-08T21:34:33.966829+0000","last_fullsized":"2024-03-08T21:34:33.966829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.452862+0000","last_change":"2024-03-08T21:34:30.553385+0000","last_active":"2024-03-08T21:34:33.452862+0000","last_peered":"2024-03-08T21:34:33.452862+0000","last_clean":"2024-03-08T21:34:33.452862+0000","last_became_active":"2024-03-08T21:34:30.553114+0000","last_became_peered":"2024-03-08T21:34:30.553114+0000","last_unstale":"2024-03-08T21:34:33.452862+0000","last_undegraded":"2024-03-08T21:34:33.452862+0000","last_fullsized":"2024-03-08T21:34:33.452862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:07:49.087025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966284+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:33.966284+0000","last_peered":"2024-03-08T21:34:33.966284+0000","last_clean":"2024-03-08T21:34:33.966284+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:33.966284+0000","last_undegraded":"2024-03-08T21:34:33.966284+0000","last_fullsized":"2024-03-08T21:34:33.966284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":715723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":125881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":125937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":126899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":126899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":125369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":715633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:40.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 Processor -- start 2024-03-08T21:34:40.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 -- start start 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdd14072fe0 0x7fdd1409cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd1413d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1409b190 con 0x7fdd1409adb0 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1409d240 con 0x7fdd14072fe0 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1409d520 con 0x7fdd141448b0 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd18e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdd14072fe0 0x7fdd1409cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd19800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fdd1409adb0 0x7fdd141441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46582/0 (socket says 172.21.15.119:46582) 2024-03-08T21:34:40.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd19800640 1 -- 172.21.15.119:0/289271024 learned_addr learned my addr 172.21.15.119:0/289271024 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd18e00640 1 -- 172.21.15.119:0/289271024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 msgr2=0x7fdd1413d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1a200640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd1413d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd18e00640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd1413d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd18e00640 1 -- 172.21.15.119:0/289271024 >> v1:172.21.15.119:6789/0 conn(0x7fdd1409adb0 legacy=0x7fdd141441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd13e00640 1 -- 172.21.15.119:0/289271024 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994815718 0 0) 0x7fdd1409b190 con 0x7fdd1409adb0 2024-03-08T21:34:40.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd18e00640 1 -- 172.21.15.119:0/289271024 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14143c50 con 0x7fdd14072fe0 2024-03-08T21:34:40.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.256+0000 7fdd1a200640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd1413d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd18e00640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd14072fe0 0x7fdd1409cbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd000097c0 tx=0x7fdd0001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6921c1202996e755 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd13e00640 1 -- 172.21.15.119:0/289271024 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000ab660 con 0x7fdd14072fe0 2024-03-08T21:34:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd13e00640 1 -- 172.21.15.119:0/289271024 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000b0070 con 0x7fdd14072fe0 2024-03-08T21:34:40.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd13e00640 1 -- 172.21.15.119:0/289271024 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000aba20 con 0x7fdd14072fe0 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- 172.21.15.119:0/289271024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd14072fe0 msgr2=0x7fdd1409cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd14072fe0 0x7fdd1409cbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd000097c0 tx=0x7fdd0001c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- 172.21.15.119:0/289271024 shutdown_connections 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd1413d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 --2- 172.21.15.119:0/289271024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd14072fe0 0x7fdd1409cbf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- 172.21.15.119:0/289271024 >> 172.21.15.119:0/289271024 conn(0x7fdd1406c620 msgr2=0x7fdd1406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- 172.21.15.119:0/289271024 shutdown_connections 2024-03-08T21:34:40.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- 172.21.15.119:0/289271024 wait complete. 2024-03-08T21:34:40.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 Processor -- start 2024-03-08T21:34:40.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.260+0000 7fdd1c200640 1 -- start start 2024-03-08T21:34:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 0x7fdd140b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd140ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14151180 con 0x7fdd1409adb0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14151000 con 0x7fdd14072fe0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14151300 con 0x7fdd141448b0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52490/0 (socket says 172.21.15.119:52490) 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 -- 172.21.15.119:0/3678065426 learned_addr learned my addr 172.21.15.119:0/3678065426 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd19800640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 0x7fdd140b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1a200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd140ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 -- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 msgr2=0x7fdd140ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd140ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 -- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 msgr2=0x7fdd140b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 0x7fdd140b89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 -- 172.21.15.119:0/3678065426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd141e31e0 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd19800640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 0x7fdd140b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd18e00640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd000ad040 tx=0x7fdd0001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000bf610 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000bf7f0 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1413f040 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000bfbe0 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd14140340 con 0x7fdd1409adb0 2024-03-08T21:34:40.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.264+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd14067db0 con 0x7fdd1409adb0 2024-03-08T21:34:40.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.268+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fdd000bd020 con 0x7fdd1409adb0 2024-03-08T21:34:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.268+0000 7fdd11600640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 0x7fdcf4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.268+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd001201b0 con 0x7fdd1409adb0 2024-03-08T21:34:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.268+0000 7fdd19800640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 0x7fdcf4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.268+0000 7fdd19800640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 0x7fdcf4069b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd08007fd0 tx=0x7fdd08007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.272+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fdd00016090 con 0x7fdd1409adb0 2024-03-08T21:34:40.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.424+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd1409a020 con 0x7fdcf4067660 2024-03-08T21:34:40.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd11600640 1 -- 172.21.15.119:0/3678065426 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251927 (secure 0 0 0) 0x7fdd1409a020 con 0x7fdcf4067660 2024-03-08T21:34:40.422 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:40.424 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 msgr2=0x7fdcf4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 0x7fdcf4069b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd08007fd0 tx=0x7fdd08007c20 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 msgr2=0x7fdd141e2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd000ad040 tx=0x7fdd0001ace0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 shutdown_connections 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fdcf4067660 0x7fdcf4069b20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdd141448b0 0x7fdd140ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd1409adb0 0x7fdd141e2ca0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 --2- 172.21.15.119:0/3678065426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd14072fe0 0x7fdd140b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 >> 172.21.15.119:0/3678065426 conn(0x7fdd1406c620 msgr2=0x7fdd1413c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:40.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 shutdown_connections 2024-03-08T21:34:40.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.432+0000 7fdd1c200640 1 -- 172.21.15.119:0/3678065426 wait complete. 2024-03-08T21:34:40.442 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-03-08T21:34:40.425456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224128,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750592,"statfs":{"total":773094113280,"available":772864606208,"internally_reserved":0,"allocated":3874816,"data_stored":2187676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.895835"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453088+0000","last_change":"2024-03-08T21:34:31.552339+0000","last_active":"2024-03-08T21:34:33.453088+0000","last_peered":"2024-03-08T21:34:33.453088+0000","last_clean":"2024-03-08T21:34:33.453088+0000","last_became_active":"2024-03-08T21:34:31.552088+0000","last_became_peered":"2024-03-08T21:34:31.552088+0000","last_unstale":"2024-03-08T21:34:33.453088+0000","last_undegraded":"2024-03-08T21:34:33.453088+0000","last_fullsized":"2024-03-08T21:34:33.453088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:51:53.552856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554940+0000","last_change":"2024-03-08T21:34:31.561911+0000","last_active":"2024-03-08T21:34:32.554940+0000","last_peered":"2024-03-08T21:34:32.554940+0000","last_clean":"2024-03-08T21:34:32.554940+0000","last_became_active":"2024-03-08T21:34:31.561314+0000","last_became_peered":"2024-03-08T21:34:31.561314+0000","last_unstale":"2024-03-08T21:34:32.554940+0000","last_undegraded":"2024-03-08T21:34:32.554940+0000","last_fullsized":"2024-03-08T21:34:32.554940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:13:49.799861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966421+0000","last_change":"2024-03-08T21:34:31.560897+0000","last_active":"2024-03-08T21:34:33.966421+0000","last_peered":"2024-03-08T21:34:33.966421+0000","last_clean":"2024-03-08T21:34:33.966421+0000","last_became_active":"2024-03-08T21:34:31.559447+0000","last_became_peered":"2024-03-08T21:34:31.559447+0000","last_unstale":"2024-03-08T21:34:33.966421+0000","last_undegraded":"2024-03-08T21:34:33.966421+0000","last_fullsized":"2024-03-08T21:34:33.966421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545923+0000","last_change":"2024-03-08T21:34:31.558451+0000","last_active":"2024-03-08T21:34:33.545923+0000","last_peered":"2024-03-08T21:34:33.545923+0000","last_clean":"2024-03-08T21:34:33.545923+0000","last_became_active":"2024-03-08T21:34:31.558186+0000","last_became_peered":"2024-03-08T21:34:31.558186+0000","last_unstale":"2024-03-08T21:34:33.545923+0000","last_undegraded":"2024-03-08T21:34:33.545923+0000","last_fullsized":"2024-03-08T21:34:33.545923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:48:23.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553315+0000","last_change":"2024-03-08T21:34:31.562104+0000","last_active":"2024-03-08T21:34:32.553315+0000","last_peered":"2024-03-08T21:34:32.553315+0000","last_clean":"2024-03-08T21:34:32.553315+0000","last_became_active":"2024-03-08T21:34:31.561603+0000","last_became_peered":"2024-03-08T21:34:31.561603+0000","last_unstale":"2024-03-08T21:34:32.553315+0000","last_undegraded":"2024-03-08T21:34:32.553315+0000","last_fullsized":"2024-03-08T21:34:32.553315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:02:58.324720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554221+0000","last_change":"2024-03-08T21:34:31.560211+0000","last_active":"2024-03-08T21:34:32.554221+0000","last_peered":"2024-03-08T21:34:32.554221+0000","last_clean":"2024-03-08T21:34:32.554221+0000","last_became_active":"2024-03-08T21:34:31.559765+0000","last_became_peered":"2024-03-08T21:34:31.559765+0000","last_unstale":"2024-03-08T21:34:32.554221+0000","last_undegraded":"2024-03-08T21:34:32.554221+0000","last_fullsized":"2024-03-08T21:34:32.554221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966754+0000","last_change":"2024-03-08T21:34:31.554261+0000","last_active":"2024-03-08T21:34:33.966754+0000","last_peered":"2024-03-08T21:34:33.966754+0000","last_clean":"2024-03-08T21:34:33.966754+0000","last_became_active":"2024-03-08T21:34:31.552930+0000","last_became_peered":"2024-03-08T21:34:31.552930+0000","last_unstale":"2024-03-08T21:34:33.966754+0000","last_undegraded":"2024-03-08T21:34:33.966754+0000","last_fullsized":"2024-03-08T21:34:33.966754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966108+0000","last_change":"2024-03-08T21:34:31.561150+0000","last_active":"2024-03-08T21:34:33.966108+0000","last_peered":"2024-03-08T21:34:33.966108+0000","last_clean":"2024-03-08T21:34:33.966108+0000","last_became_active":"2024-03-08T21:34:31.558489+0000","last_became_peered":"2024-03-08T21:34:31.558489+0000","last_unstale":"2024-03-08T21:34:33.966108+0000","last_undegraded":"2024-03-08T21:34:33.966108+0000","last_fullsized":"2024-03-08T21:34:33.966108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:28.216676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551689+0000","last_change":"2024-03-08T21:34:31.549765+0000","last_active":"2024-03-08T21:34:32.551689+0000","last_peered":"2024-03-08T21:34:32.551689+0000","last_clean":"2024-03-08T21:34:32.551689+0000","last_became_active":"2024-03-08T21:34:31.549143+0000","last_became_peered":"2024-03-08T21:34:31.549143+0000","last_unstale":"2024-03-08T21:34:32.551689+0000","last_undegraded":"2024-03-08T21:34:32.551689+0000","last_fullsized":"2024-03-08T21:34:32.551689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:46:48.914141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546203+0000","last_change":"2024-03-08T21:34:31.567097+0000","last_active":"2024-03-08T21:34:33.546203+0000","last_peered":"2024-03-08T21:34:33.546203+0000","last_clean":"2024-03-08T21:34:33.546203+0000","last_became_active":"2024-03-08T21:34:31.566774+0000","last_became_peered":"2024-03-08T21:34:31.566774+0000","last_unstale":"2024-03-08T21:34:33.546203+0000","last_undegraded":"2024-03-08T21:34:33.546203+0000","last_fullsized":"2024-03-08T21:34:33.546203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.967178+0000","last_change":"2024-03-08T21:34:31.546258+0000","last_active":"2024-03-08T21:34:33.967178+0000","last_peered":"2024-03-08T21:34:33.967178+0000","last_clean":"2024-03-08T21:34:33.967178+0000","last_became_active":"2024-03-08T21:34:31.545472+0000","last_became_peered":"2024-03-08T21:34:31.545472+0000","last_unstale":"2024-03-08T21:34:33.967178+0000","last_undegraded":"2024-03-08T21:34:33.967178+0000","last_fullsized":"2024-03-08T21:34:33.967178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966147+0000","last_change":"2024-03-08T21:34:31.550711+0000","last_active":"2024-03-08T21:34:33.966147+0000","last_peered":"2024-03-08T21:34:33.966147+0000","last_clean":"2024-03-08T21:34:33.966147+0000","last_became_active":"2024-03-08T21:34:31.550387+0000","last_became_peered":"2024-03-08T21:34:31.550387+0000","last_unstale":"2024-03-08T21:34:33.966147+0000","last_undegraded":"2024-03-08T21:34:33.966147+0000","last_fullsized":"2024-03-08T21:34:33.966147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553325+0000","last_change":"2024-03-08T21:34:31.546290+0000","last_active":"2024-03-08T21:34:32.553325+0000","last_peered":"2024-03-08T21:34:32.553325+0000","last_clean":"2024-03-08T21:34:32.553325+0000","last_became_active":"2024-03-08T21:34:31.546033+0000","last_became_peered":"2024-03-08T21:34:31.546033+0000","last_unstale":"2024-03-08T21:34:32.553325+0000","last_undegraded":"2024-03-08T21:34:32.553325+0000","last_fullsized":"2024-03-08T21:34:32.553325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:27:14.540159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554338+0000","last_change":"2024-03-08T21:34:31.559962+0000","last_active":"2024-03-08T21:34:32.554338+0000","last_peered":"2024-03-08T21:34:32.554338+0000","last_clean":"2024-03-08T21:34:32.554338+0000","last_became_active":"2024-03-08T21:34:31.559478+0000","last_became_peered":"2024-03-08T21:34:31.559478+0000","last_unstale":"2024-03-08T21:34:32.554338+0000","last_undegraded":"2024-03-08T21:34:32.554338+0000","last_fullsized":"2024-03-08T21:34:32.554338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.965838+0000","last_change":"2024-03-08T21:34:31.554173+0000","last_active":"2024-03-08T21:34:33.965838+0000","last_peered":"2024-03-08T21:34:33.965838+0000","last_clean":"2024-03-08T21:34:33.965838+0000","last_became_active":"2024-03-08T21:34:31.553870+0000","last_became_peered":"2024-03-08T21:34:31.553870+0000","last_unstale":"2024-03-08T21:34:33.965838+0000","last_undegraded":"2024-03-08T21:34:33.965838+0000","last_fullsized":"2024-03-08T21:34:33.965838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966656+0000","last_change":"2024-03-08T21:34:31.556213+0000","last_active":"2024-03-08T21:34:33.966656+0000","last_peered":"2024-03-08T21:34:33.966656+0000","last_clean":"2024-03-08T21:34:33.966656+0000","last_became_active":"2024-03-08T21:34:31.555630+0000","last_became_peered":"2024-03-08T21:34:31.555630+0000","last_unstale":"2024-03-08T21:34:33.966656+0000","last_undegraded":"2024-03-08T21:34:33.966656+0000","last_fullsized":"2024-03-08T21:34:33.966656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.967178+0000","last_change":"2024-03-08T21:34:31.547267+0000","last_active":"2024-03-08T21:34:33.967178+0000","last_peered":"2024-03-08T21:34:33.967178+0000","last_clean":"2024-03-08T21:34:33.967178+0000","last_became_active":"2024-03-08T21:34:31.547030+0000","last_became_peered":"2024-03-08T21:34:31.547030+0000","last_unstale":"2024-03-08T21:34:33.967178+0000","last_undegraded":"2024-03-08T21:34:33.967178+0000","last_fullsized":"2024-03-08T21:34:33.967178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554962+0000","last_change":"2024-03-08T21:34:31.554196+0000","last_active":"2024-03-08T21:34:32.554962+0000","last_peered":"2024-03-08T21:34:32.554962+0000","last_clean":"2024-03-08T21:34:32.554962+0000","last_became_active":"2024-03-08T21:34:31.553748+0000","last_became_peered":"2024-03-08T21:34:31.553748+0000","last_unstale":"2024-03-08T21:34:32.554962+0000","last_undegraded":"2024-03-08T21:34:32.554962+0000","last_fullsized":"2024-03-08T21:34:32.554962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:25:22.907673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554659+0000","last_change":"2024-03-08T21:34:31.570716+0000","last_active":"2024-03-08T21:34:32.554659+0000","last_peered":"2024-03-08T21:34:32.554659+0000","last_clean":"2024-03-08T21:34:32.554659+0000","last_became_active":"2024-03-08T21:34:31.570352+0000","last_became_peered":"2024-03-08T21:34:31.570352+0000","last_unstale":"2024-03-08T21:34:32.554659+0000","last_undegraded":"2024-03-08T21:34:32.554659+0000","last_fullsized":"2024-03-08T21:34:32.554659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:46.793394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553497+0000","last_change":"2024-03-08T21:34:31.546633+0000","last_active":"2024-03-08T21:34:32.553497+0000","last_peered":"2024-03-08T21:34:32.553497+0000","last_clean":"2024-03-08T21:34:32.553497+0000","last_became_active":"2024-03-08T21:34:31.546360+0000","last_became_peered":"2024-03-08T21:34:31.546360+0000","last_unstale":"2024-03-08T21:34:32.553497+0000","last_undegraded":"2024-03-08T21:34:32.553497+0000","last_fullsized":"2024-03-08T21:34:32.553497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:40.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551505+0000","last_change":"2024-03-08T21:34:31.546993+0000","last_active":"2024-03-08T21:34:32.551505+0000","last_peered":"2024-03-08T21:34:32.551505+0000","last_clean":"2024-03-08T21:34:32.551505+0000","last_became_active":"2024-03-08T21:34:31.546799+0000","last_became_peered":"2024-03-08T21:34:31.546799+0000","last_unstale":"2024-03-08T21:34:32.551505+0000","last_undegraded":"2024-03-08T21:34:32.551505+0000","last_fullsized":"2024-03-08T21:34:32.551505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:14:02.922078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551375+0000","last_change":"2024-03-08T21:34:31.553583+0000","last_active":"2024-03-08T21:34:32.551375+0000","last_peered":"2024-03-08T21:34:32.551375+0000","last_clean":"2024-03-08T21:34:32.551375+0000","last_became_active":"2024-03-08T21:34:31.550846+0000","last_became_peered":"2024-03-08T21:34:31.550846+0000","last_unstale":"2024-03-08T21:34:32.551375+0000","last_undegraded":"2024-03-08T21:34:32.551375+0000","last_fullsized":"2024-03-08T21:34:32.551375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:16:22.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821208+0000","last_change":"2024-03-08T21:34:31.539324+0000","last_active":"2024-03-08T21:34:32.821208+0000","last_peered":"2024-03-08T21:34:32.821208+0000","last_clean":"2024-03-08T21:34:32.821208+0000","last_became_active":"2024-03-08T21:34:31.539046+0000","last_became_peered":"2024-03-08T21:34:31.539046+0000","last_unstale":"2024-03-08T21:34:32.821208+0000","last_undegraded":"2024-03-08T21:34:32.821208+0000","last_fullsized":"2024-03-08T21:34:32.821208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:04.251342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966109+0000","last_change":"2024-03-08T21:34:31.557147+0000","last_active":"2024-03-08T21:34:33.966109+0000","last_peered":"2024-03-08T21:34:33.966109+0000","last_clean":"2024-03-08T21:34:33.966109+0000","last_became_active":"2024-03-08T21:34:31.556879+0000","last_became_peered":"2024-03-08T21:34:31.556879+0000","last_unstale":"2024-03-08T21:34:33.966109+0000","last_undegraded":"2024-03-08T21:34:33.966109+0000","last_fullsized":"2024-03-08T21:34:33.966109+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546366+0000","last_change":"2024-03-08T21:34:31.547201+0000","last_active":"2024-03-08T21:34:33.546366+0000","last_peered":"2024-03-08T21:34:33.546366+0000","last_clean":"2024-03-08T21:34:33.546366+0000","last_became_active":"2024-03-08T21:34:31.545804+0000","last_became_peered":"2024-03-08T21:34:31.545804+0000","last_unstale":"2024-03-08T21:34:33.546366+0000","last_undegraded":"2024-03-08T21:34:33.546366+0000","last_fullsized":"2024-03-08T21:34:33.546366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.555078+0000","last_change":"2024-03-08T21:34:31.553984+0000","last_active":"2024-03-08T21:34:32.555078+0000","last_peered":"2024-03-08T21:34:32.555078+0000","last_clean":"2024-03-08T21:34:32.555078+0000","last_became_active":"2024-03-08T21:34:31.553482+0000","last_became_peered":"2024-03-08T21:34:31.553482+0000","last_unstale":"2024-03-08T21:34:32.555078+0000","last_undegraded":"2024-03-08T21:34:32.555078+0000","last_fullsized":"2024-03-08T21:34:32.555078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:08:20.944549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546216+0000","last_change":"2024-03-08T21:34:31.552703+0000","last_active":"2024-03-08T21:34:33.546216+0000","last_peered":"2024-03-08T21:34:33.546216+0000","last_clean":"2024-03-08T21:34:33.546216+0000","last_became_active":"2024-03-08T21:34:31.552416+0000","last_became_peered":"2024-03-08T21:34:31.552416+0000","last_unstale":"2024-03-08T21:34:33.546216+0000","last_undegraded":"2024-03-08T21:34:33.546216+0000","last_fullsized":"2024-03-08T21:34:33.546216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:41:33.932516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966253+0000","last_change":"2024-03-08T21:34:31.565192+0000","last_active":"2024-03-08T21:34:33.966253+0000","last_peered":"2024-03-08T21:34:33.966253+0000","last_clean":"2024-03-08T21:34:33.966253+0000","last_became_active":"2024-03-08T21:34:31.564920+0000","last_became_peered":"2024-03-08T21:34:31.564920+0000","last_unstale":"2024-03-08T21:34:33.966253+0000","last_undegraded":"2024-03-08T21:34:33.966253+0000","last_fullsized":"2024-03-08T21:34:33.966253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:29:46.493598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551485+0000","last_change":"2024-03-08T21:34:31.551813+0000","last_active":"2024-03-08T21:34:32.551485+0000","last_peered":"2024-03-08T21:34:32.551485+0000","last_clean":"2024-03-08T21:34:32.551485+0000","last_became_active":"2024-03-08T21:34:31.551548+0000","last_became_peered":"2024-03-08T21:34:31.551548+0000","last_unstale":"2024-03-08T21:34:32.551485+0000","last_undegraded":"2024-03-08T21:34:32.551485+0000","last_fullsized":"2024-03-08T21:34:32.551485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:20:19.267167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966573+0000","last_change":"2024-03-08T21:34:31.549644+0000","last_active":"2024-03-08T21:34:33.966573+0000","last_peered":"2024-03-08T21:34:33.966573+0000","last_clean":"2024-03-08T21:34:33.966573+0000","last_became_active":"2024-03-08T21:34:31.549334+0000","last_became_peered":"2024-03-08T21:34:31.549334+0000","last_unstale":"2024-03-08T21:34:33.966573+0000","last_undegraded":"2024-03-08T21:34:33.966573+0000","last_fullsized":"2024-03-08T21:34:33.966573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453096+0000","last_change":"2024-03-08T21:34:31.552011+0000","last_active":"2024-03-08T21:34:33.453096+0000","last_peered":"2024-03-08T21:34:33.453096+0000","last_clean":"2024-03-08T21:34:33.453096+0000","last_became_active":"2024-03-08T21:34:31.551719+0000","last_became_peered":"2024-03-08T21:34:31.551719+0000","last_unstale":"2024-03-08T21:34:33.453096+0000","last_undegraded":"2024-03-08T21:34:33.453096+0000","last_fullsized":"2024-03-08T21:34:33.453096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:13:37.594488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966191+0000","last_change":"2024-03-08T21:34:31.541777+0000","last_active":"2024-03-08T21:34:33.966191+0000","last_peered":"2024-03-08T21:34:33.966191+0000","last_clean":"2024-03-08T21:34:33.966191+0000","last_became_active":"2024-03-08T21:34:31.541486+0000","last_became_peered":"2024-03-08T21:34:31.541486+0000","last_unstale":"2024-03-08T21:34:33.966191+0000","last_undegraded":"2024-03-08T21:34:33.966191+0000","last_fullsized":"2024-03-08T21:34:33.966191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:48:23.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821385+0000","last_change":"2024-03-08T21:34:31.544651+0000","last_active":"2024-03-08T21:34:32.821385+0000","last_peered":"2024-03-08T21:34:32.821385+0000","last_clean":"2024-03-08T21:34:32.821385+0000","last_became_active":"2024-03-08T21:34:31.544360+0000","last_became_peered":"2024-03-08T21:34:31.544360+0000","last_unstale":"2024-03-08T21:34:32.821385+0000","last_undegraded":"2024-03-08T21:34:32.821385+0000","last_fullsized":"2024-03-08T21:34:32.821385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:35:19.289201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453217+0000","last_change":"2024-03-08T21:34:30.554739+0000","last_active":"2024-03-08T21:34:33.453217+0000","last_peered":"2024-03-08T21:34:33.453217+0000","last_clean":"2024-03-08T21:34:33.453217+0000","last_became_active":"2024-03-08T21:34:30.554507+0000","last_became_peered":"2024-03-08T21:34:30.554507+0000","last_unstale":"2024-03-08T21:34:33.453217+0000","last_undegraded":"2024-03-08T21:34:33.453217+0000","last_fullsized":"2024-03-08T21:34:33.453217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:20:21.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453202+0000","last_change":"2024-03-08T21:34:31.556398+0000","last_active":"2024-03-08T21:34:33.453202+0000","last_peered":"2024-03-08T21:34:33.453202+0000","last_clean":"2024-03-08T21:34:33.453202+0000","last_became_active":"2024-03-08T21:34:31.555986+0000","last_became_peered":"2024-03-08T21:34:31.555986+0000","last_unstale":"2024-03-08T21:34:33.453202+0000","last_undegraded":"2024-03-08T21:34:33.453202+0000","last_fullsized":"2024-03-08T21:34:33.453202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:58:53.572351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821304+0000","last_change":"2024-03-08T21:34:30.552607+0000","last_active":"2024-03-08T21:34:32.821304+0000","last_peered":"2024-03-08T21:34:32.821304+0000","last_clean":"2024-03-08T21:34:32.821304+0000","last_became_active":"2024-03-08T21:34:30.552276+0000","last_became_peered":"2024-03-08T21:34:30.552276+0000","last_unstale":"2024-03-08T21:34:32.821304+0000","last_undegraded":"2024-03-08T21:34:32.821304+0000","last_fullsized":"2024-03-08T21:34:32.821304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:28:58.375670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551168+0000","last_change":"2024-03-08T21:34:31.554706+0000","last_active":"2024-03-08T21:34:32.551168+0000","last_peered":"2024-03-08T21:34:32.551168+0000","last_clean":"2024-03-08T21:34:32.551168+0000","last_became_active":"2024-03-08T21:34:31.552133+0000","last_became_peered":"2024-03-08T21:34:31.552133+0000","last_unstale":"2024-03-08T21:34:32.551168+0000","last_undegraded":"2024-03-08T21:34:32.551168+0000","last_fullsized":"2024-03-08T21:34:32.551168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:35:19.289201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554595+0000","last_change":"2024-03-08T21:34:30.556124+0000","last_active":"2024-03-08T21:34:32.554595+0000","last_peered":"2024-03-08T21:34:32.554595+0000","last_clean":"2024-03-08T21:34:32.554595+0000","last_became_active":"2024-03-08T21:34:30.554853+0000","last_became_peered":"2024-03-08T21:34:30.554853+0000","last_unstale":"2024-03-08T21:34:32.554595+0000","last_undegraded":"2024-03-08T21:34:32.554595+0000","last_fullsized":"2024-03-08T21:34:32.554595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:51:52.543554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546279+0000","last_change":"2024-03-08T21:34:31.558187+0000","last_active":"2024-03-08T21:34:33.546279+0000","last_peered":"2024-03-08T21:34:33.546279+0000","last_clean":"2024-03-08T21:34:33.546279+0000","last_became_active":"2024-03-08T21:34:31.557876+0000","last_became_peered":"2024-03-08T21:34:31.557876+0000","last_unstale":"2024-03-08T21:34:33.546279+0000","last_undegraded":"2024-03-08T21:34:33.546279+0000","last_fullsized":"2024-03-08T21:34:33.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553474+0000","last_change":"2024-03-08T21:34:30.560868+0000","last_active":"2024-03-08T21:34:32.553474+0000","last_peered":"2024-03-08T21:34:32.553474+0000","last_clean":"2024-03-08T21:34:32.553474+0000","last_became_active":"2024-03-08T21:34:30.560595+0000","last_became_peered":"2024-03-08T21:34:30.560595+0000","last_unstale":"2024-03-08T21:34:32.553474+0000","last_undegraded":"2024-03-08T21:34:32.553474+0000","last_fullsized":"2024-03-08T21:34:32.553474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:46:04.154633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966742+0000","last_change":"2024-03-08T21:34:31.545948+0000","last_active":"2024-03-08T21:34:33.966742+0000","last_peered":"2024-03-08T21:34:33.966742+0000","last_clean":"2024-03-08T21:34:33.966742+0000","last_became_active":"2024-03-08T21:34:31.545650+0000","last_became_peered":"2024-03-08T21:34:31.545650+0000","last_unstale":"2024-03-08T21:34:33.966742+0000","last_undegraded":"2024-03-08T21:34:33.966742+0000","last_fullsized":"2024-03-08T21:34:33.966742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551615+0000","last_change":"2024-03-08T21:34:30.550115+0000","last_active":"2024-03-08T21:34:32.551615+0000","last_peered":"2024-03-08T21:34:32.551615+0000","last_clean":"2024-03-08T21:34:32.551615+0000","last_became_active":"2024-03-08T21:34:30.549841+0000","last_became_peered":"2024-03-08T21:34:30.549841+0000","last_unstale":"2024-03-08T21:34:32.551615+0000","last_undegraded":"2024-03-08T21:34:32.551615+0000","last_fullsized":"2024-03-08T21:34:32.551615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:52:11.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966056+0000","last_change":"2024-03-08T21:34:31.562306+0000","last_active":"2024-03-08T21:34:33.966056+0000","last_peered":"2024-03-08T21:34:33.966056+0000","last_clean":"2024-03-08T21:34:33.966056+0000","last_became_active":"2024-03-08T21:34:31.562033+0000","last_became_peered":"2024-03-08T21:34:31.562033+0000","last_unstale":"2024-03-08T21:34:33.966056+0000","last_undegraded":"2024-03-08T21:34:33.966056+0000","last_fullsized":"2024-03-08T21:34:33.966056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:52:20.970135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551366+0000","last_change":"2024-03-08T21:34:30.545293+0000","last_active":"2024-03-08T21:34:32.551366+0000","last_peered":"2024-03-08T21:34:32.551366+0000","last_clean":"2024-03-08T21:34:32.551366+0000","last_became_active":"2024-03-08T21:34:30.544985+0000","last_became_peered":"2024-03-08T21:34:30.544985+0000","last_unstale":"2024-03-08T21:34:32.551366+0000","last_undegraded":"2024-03-08T21:34:32.551366+0000","last_fullsized":"2024-03-08T21:34:32.551366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:05:20.453770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550847+0000","last_change":"2024-03-08T21:34:31.557748+0000","last_active":"2024-03-08T21:34:32.550847+0000","last_peered":"2024-03-08T21:34:32.550847+0000","last_clean":"2024-03-08T21:34:32.550847+0000","last_became_active":"2024-03-08T21:34:31.549115+0000","last_became_peered":"2024-03-08T21:34:31.549115+0000","last_unstale":"2024-03-08T21:34:32.550847+0000","last_undegraded":"2024-03-08T21:34:32.550847+0000","last_fullsized":"2024-03-08T21:34:32.550847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:04.251342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553907+0000","last_change":"2024-03-08T21:34:30.546435+0000","last_active":"2024-03-08T21:34:32.553907+0000","last_peered":"2024-03-08T21:34:32.553907+0000","last_clean":"2024-03-08T21:34:32.553907+0000","last_became_active":"2024-03-08T21:34:30.546147+0000","last_became_peered":"2024-03-08T21:34:30.546147+0000","last_unstale":"2024-03-08T21:34:32.553907+0000","last_undegraded":"2024-03-08T21:34:32.553907+0000","last_fullsized":"2024-03-08T21:34:32.553907+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:57:33.669073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545708+0000","last_change":"2024-03-08T21:34:31.543843+0000","last_active":"2024-03-08T21:34:33.545708+0000","last_peered":"2024-03-08T21:34:33.545708+0000","last_clean":"2024-03-08T21:34:33.545708+0000","last_became_active":"2024-03-08T21:34:31.543545+0000","last_became_peered":"2024-03-08T21:34:31.543545+0000","last_unstale":"2024-03-08T21:34:33.545708+0000","last_undegraded":"2024-03-08T21:34:33.545708+0000","last_fullsized":"2024-03-08T21:34:33.545708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:21:55.608760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550786+0000","last_change":"2024-03-08T21:34:30.546979+0000","last_active":"2024-03-08T21:34:32.550786+0000","last_peered":"2024-03-08T21:34:32.550786+0000","last_clean":"2024-03-08T21:34:32.550786+0000","last_became_active":"2024-03-08T21:34:30.546662+0000","last_became_peered":"2024-03-08T21:34:30.546662+0000","last_unstale":"2024-03-08T21:34:32.550786+0000","last_undegraded":"2024-03-08T21:34:32.550786+0000","last_fullsized":"2024-03-08T21:34:32.550786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:54:59.925309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966553+0000","last_change":"2024-03-08T21:34:31.560602+0000","last_active":"2024-03-08T21:34:33.966553+0000","last_peered":"2024-03-08T21:34:33.966553+0000","last_clean":"2024-03-08T21:34:33.966553+0000","last_became_active":"2024-03-08T21:34:31.560360+0000","last_became_peered":"2024-03-08T21:34:31.560360+0000","last_unstale":"2024-03-08T21:34:33.966553+0000","last_undegraded":"2024-03-08T21:34:33.966553+0000","last_fullsized":"2024-03-08T21:34:33.966553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:41:06.592701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554876+0000","last_change":"2024-03-08T21:34:30.543584+0000","last_active":"2024-03-08T21:34:32.554876+0000","last_peered":"2024-03-08T21:34:32.554876+0000","last_clean":"2024-03-08T21:34:32.554876+0000","last_became_active":"2024-03-08T21:34:30.543318+0000","last_became_peered":"2024-03-08T21:34:30.543318+0000","last_unstale":"2024-03-08T21:34:32.554876+0000","last_undegraded":"2024-03-08T21:34:32.554876+0000","last_fullsized":"2024-03-08T21:34:32.554876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:58:52.563049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554948+0000","last_change":"2024-03-08T21:34:31.570551+0000","last_active":"2024-03-08T21:34:32.554948+0000","last_peered":"2024-03-08T21:34:32.554948+0000","last_clean":"2024-03-08T21:34:32.554948+0000","last_became_active":"2024-03-08T21:34:31.569930+0000","last_became_peered":"2024-03-08T21:34:31.569930+0000","last_unstale":"2024-03-08T21:34:32.554948+0000","last_undegraded":"2024-03-08T21:34:32.554948+0000","last_fullsized":"2024-03-08T21:34:32.554948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:33:26.012222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821421+0000","last_change":"2024-03-08T21:34:30.552003+0000","last_active":"2024-03-08T21:34:32.821421+0000","last_peered":"2024-03-08T21:34:32.821421+0000","last_clean":"2024-03-08T21:34:32.821421+0000","last_became_active":"2024-03-08T21:34:30.551696+0000","last_became_peered":"2024-03-08T21:34:30.551696+0000","last_unstale":"2024-03-08T21:34:32.821421+0000","last_undegraded":"2024-03-08T21:34:32.821421+0000","last_fullsized":"2024-03-08T21:34:32.821421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:03:05.385139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554682+0000","last_change":"2024-03-08T21:34:31.548911+0000","last_active":"2024-03-08T21:34:32.554682+0000","last_peered":"2024-03-08T21:34:32.554682+0000","last_clean":"2024-03-08T21:34:32.554682+0000","last_became_active":"2024-03-08T21:34:31.548576+0000","last_became_peered":"2024-03-08T21:34:31.548576+0000","last_unstale":"2024-03-08T21:34:32.554682+0000","last_undegraded":"2024-03-08T21:34:32.554682+0000","last_fullsized":"2024-03-08T21:34:32.554682+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:09:34.397830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966428+0000","last_change":"2024-03-08T21:34:30.550186+0000","last_active":"2024-03-08T21:34:33.966428+0000","last_peered":"2024-03-08T21:34:33.966428+0000","last_clean":"2024-03-08T21:34:33.966428+0000","last_became_active":"2024-03-08T21:34:30.548951+0000","last_became_peered":"2024-03-08T21:34:30.548951+0000","last_unstale":"2024-03-08T21:34:33.966428+0000","last_undegraded":"2024-03-08T21:34:33.966428+0000","last_fullsized":"2024-03-08T21:34:33.966428+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966262+0000","last_change":"2024-03-08T21:34:31.559327+0000","last_active":"2024-03-08T21:34:33.966262+0000","last_peered":"2024-03-08T21:34:33.966262+0000","last_clean":"2024-03-08T21:34:33.966262+0000","last_became_active":"2024-03-08T21:34:31.558932+0000","last_became_peered":"2024-03-08T21:34:31.558932+0000","last_unstale":"2024-03-08T21:34:33.966262+0000","last_undegraded":"2024-03-08T21:34:33.966262+0000","last_fullsized":"2024-03-08T21:34:33.966262+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554613+0000","last_change":"2024-03-08T21:34:30.556419+0000","last_active":"2024-03-08T21:34:32.554613+0000","last_peered":"2024-03-08T21:34:32.554613+0000","last_clean":"2024-03-08T21:34:32.554613+0000","last_became_active":"2024-03-08T21:34:30.556144+0000","last_became_peered":"2024-03-08T21:34:30.556144+0000","last_unstale":"2024-03-08T21:34:32.554613+0000","last_undegraded":"2024-03-08T21:34:32.554613+0000","last_fullsized":"2024-03-08T21:34:32.554613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:13:36.585185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545719+0000","last_change":"2024-03-08T21:34:31.543818+0000","last_active":"2024-03-08T21:34:33.545719+0000","last_peered":"2024-03-08T21:34:33.545719+0000","last_clean":"2024-03-08T21:34:33.545719+0000","last_became_active":"2024-03-08T21:34:31.543483+0000","last_became_peered":"2024-03-08T21:34:31.543483+0000","last_unstale":"2024-03-08T21:34:33.545719+0000","last_undegraded":"2024-03-08T21:34:33.545719+0000","last_fullsized":"2024-03-08T21:34:33.545719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:10:28.216676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551616+0000","last_change":"2024-03-08T21:34:30.550329+0000","last_active":"2024-03-08T21:34:32.551616+0000","last_peered":"2024-03-08T21:34:32.551616+0000","last_clean":"2024-03-08T21:34:32.551616+0000","last_became_active":"2024-03-08T21:34:30.549320+0000","last_became_peered":"2024-03-08T21:34:30.549320+0000","last_unstale":"2024-03-08T21:34:32.551616+0000","last_undegraded":"2024-03-08T21:34:32.551616+0000","last_fullsized":"2024-03-08T21:34:32.551616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:04:48.901291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554583+0000","last_change":"2024-03-08T21:34:31.560917+0000","last_active":"2024-03-08T21:34:32.554583+0000","last_peered":"2024-03-08T21:34:32.554583+0000","last_clean":"2024-03-08T21:34:32.554583+0000","last_became_active":"2024-03-08T21:34:31.560666+0000","last_became_peered":"2024-03-08T21:34:31.560666+0000","last_unstale":"2024-03-08T21:34:32.554583+0000","last_undegraded":"2024-03-08T21:34:32.554583+0000","last_fullsized":"2024-03-08T21:34:32.554583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545706+0000","last_change":"2024-03-08T21:34:30.553209+0000","last_active":"2024-03-08T21:34:33.545706+0000","last_peered":"2024-03-08T21:34:33.545706+0000","last_clean":"2024-03-08T21:34:33.545706+0000","last_became_active":"2024-03-08T21:34:30.552968+0000","last_became_peered":"2024-03-08T21:34:30.552968+0000","last_unstale":"2024-03-08T21:34:33.545706+0000","last_undegraded":"2024-03-08T21:34:33.545706+0000","last_fullsized":"2024-03-08T21:34:33.545706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:39.894974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966229+0000","last_change":"2024-03-08T21:34:31.556449+0000","last_active":"2024-03-08T21:34:33.966229+0000","last_peered":"2024-03-08T21:34:33.966229+0000","last_clean":"2024-03-08T21:34:33.966229+0000","last_became_active":"2024-03-08T21:34:31.555944+0000","last_became_peered":"2024-03-08T21:34:31.555944+0000","last_unstale":"2024-03-08T21:34:33.966229+0000","last_undegraded":"2024-03-08T21:34:33.966229+0000","last_fullsized":"2024-03-08T21:34:33.966229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553934+0000","last_change":"2024-03-08T21:34:30.544575+0000","last_active":"2024-03-08T21:34:32.553934+0000","last_peered":"2024-03-08T21:34:32.553934+0000","last_clean":"2024-03-08T21:34:32.553934+0000","last_became_active":"2024-03-08T21:34:30.544164+0000","last_became_peered":"2024-03-08T21:34:30.544164+0000","last_unstale":"2024-03-08T21:34:32.553934+0000","last_undegraded":"2024-03-08T21:34:32.553934+0000","last_fullsized":"2024-03-08T21:34:32.553934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:20:26.256691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453066+0000","last_change":"2024-03-08T21:34:31.558954+0000","last_active":"2024-03-08T21:34:33.453066+0000","last_peered":"2024-03-08T21:34:33.453066+0000","last_clean":"2024-03-08T21:34:33.453066+0000","last_became_active":"2024-03-08T21:34:31.558702+0000","last_became_peered":"2024-03-08T21:34:31.558702+0000","last_unstale":"2024-03-08T21:34:33.453066+0000","last_undegraded":"2024-03-08T21:34:33.453066+0000","last_fullsized":"2024-03-08T21:34:33.453066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:20:27.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553918+0000","last_change":"2024-03-08T21:34:30.547624+0000","last_active":"2024-03-08T21:34:32.553918+0000","last_peered":"2024-03-08T21:34:32.553918+0000","last_clean":"2024-03-08T21:34:32.553918+0000","last_became_active":"2024-03-08T21:34:30.547323+0000","last_became_peered":"2024-03-08T21:34:30.547323+0000","last_unstale":"2024-03-08T21:34:32.553918+0000","last_undegraded":"2024-03-08T21:34:32.553918+0000","last_fullsized":"2024-03-08T21:34:32.553918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551043+0000","last_change":"2024-03-08T21:34:31.556373+0000","last_active":"2024-03-08T21:34:32.551043+0000","last_peered":"2024-03-08T21:34:32.551043+0000","last_clean":"2024-03-08T21:34:32.551043+0000","last_became_active":"2024-03-08T21:34:31.552758+0000","last_became_peered":"2024-03-08T21:34:31.552758+0000","last_unstale":"2024-03-08T21:34:32.551043+0000","last_undegraded":"2024-03-08T21:34:32.551043+0000","last_fullsized":"2024-03-08T21:34:32.551043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:06:54.847854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546398+0000","last_change":"2024-03-08T21:34:30.556652+0000","last_active":"2024-03-08T21:34:33.546398+0000","last_peered":"2024-03-08T21:34:33.546398+0000","last_clean":"2024-03-08T21:34:33.546398+0000","last_became_active":"2024-03-08T21:34:30.555919+0000","last_became_peered":"2024-03-08T21:34:30.555919+0000","last_unstale":"2024-03-08T21:34:33.546398+0000","last_undegraded":"2024-03-08T21:34:33.546398+0000","last_fullsized":"2024-03-08T21:34:33.546398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:10:39.936700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966772+0000","last_change":"2024-03-08T21:34:31.556923+0000","last_active":"2024-03-08T21:34:33.966772+0000","last_peered":"2024-03-08T21:34:33.966772+0000","last_clean":"2024-03-08T21:34:33.966772+0000","last_became_active":"2024-03-08T21:34:31.556657+0000","last_became_peered":"2024-03-08T21:34:31.556657+0000","last_unstale":"2024-03-08T21:34:33.966772+0000","last_undegraded":"2024-03-08T21:34:33.966772+0000","last_fullsized":"2024-03-08T21:34:33.966772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T23:21:05.779293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551370+0000","last_change":"2024-03-08T21:34:30.549334+0000","last_active":"2024-03-08T21:34:32.551370+0000","last_peered":"2024-03-08T21:34:32.551370+0000","last_clean":"2024-03-08T21:34:32.551370+0000","last_became_active":"2024-03-08T21:34:30.549045+0000","last_became_peered":"2024-03-08T21:34:30.549045+0000","last_unstale":"2024-03-08T21:34:32.551370+0000","last_undegraded":"2024-03-08T21:34:32.551370+0000","last_fullsized":"2024-03-08T21:34:32.551370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:23:44.306090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545995+0000","last_change":"2024-03-08T21:34:31.552410+0000","last_active":"2024-03-08T21:34:33.545995+0000","last_peered":"2024-03-08T21:34:33.545995+0000","last_clean":"2024-03-08T21:34:33.545995+0000","last_became_active":"2024-03-08T21:34:31.552145+0000","last_became_peered":"2024-03-08T21:34:31.552145+0000","last_unstale":"2024-03-08T21:34:33.545995+0000","last_undegraded":"2024-03-08T21:34:33.545995+0000","last_fullsized":"2024-03-08T21:34:33.545995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:20:34.949208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551216+0000","last_change":"2024-03-08T21:34:30.551684+0000","last_active":"2024-03-08T21:34:32.551216+0000","last_peered":"2024-03-08T21:34:32.551216+0000","last_clean":"2024-03-08T21:34:32.551216+0000","last_became_active":"2024-03-08T21:34:30.550864+0000","last_became_peered":"2024-03-08T21:34:30.550864+0000","last_unstale":"2024-03-08T21:34:32.551216+0000","last_undegraded":"2024-03-08T21:34:32.551216+0000","last_fullsized":"2024-03-08T21:34:32.551216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:04:21.543617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553471+0000","last_change":"2024-03-08T21:34:31.545726+0000","last_active":"2024-03-08T21:34:32.553471+0000","last_peered":"2024-03-08T21:34:32.553471+0000","last_clean":"2024-03-08T21:34:32.553471+0000","last_became_active":"2024-03-08T21:34:31.545457+0000","last_became_peered":"2024-03-08T21:34:31.545457+0000","last_unstale":"2024-03-08T21:34:32.553471+0000","last_undegraded":"2024-03-08T21:34:32.553471+0000","last_fullsized":"2024-03-08T21:34:32.553471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T21:50:19.029413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551295+0000","last_change":"2024-03-08T21:34:30.550579+0000","last_active":"2024-03-08T21:34:32.551295+0000","last_peered":"2024-03-08T21:34:32.551295+0000","last_clean":"2024-03-08T21:34:32.551295+0000","last_became_active":"2024-03-08T21:34:30.550209+0000","last_became_peered":"2024-03-08T21:34:30.550209+0000","last_unstale":"2024-03-08T21:34:32.551295+0000","last_undegraded":"2024-03-08T21:34:32.551295+0000","last_fullsized":"2024-03-08T21:34:32.551295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:11:08.440051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553267+0000","last_change":"2024-03-08T21:34:31.556322+0000","last_active":"2024-03-08T21:34:32.553267+0000","last_peered":"2024-03-08T21:34:32.553267+0000","last_clean":"2024-03-08T21:34:32.553267+0000","last_became_active":"2024-03-08T21:34:31.555984+0000","last_became_peered":"2024-03-08T21:34:31.555984+0000","last_unstale":"2024-03-08T21:34:32.553267+0000","last_undegraded":"2024-03-08T21:34:32.553267+0000","last_fullsized":"2024-03-08T21:34:32.553267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:33:47.839788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821324+0000","last_change":"2024-03-08T21:34:30.560190+0000","last_active":"2024-03-08T21:34:32.821324+0000","last_peered":"2024-03-08T21:34:32.821324+0000","last_clean":"2024-03-08T21:34:32.821324+0000","last_became_active":"2024-03-08T21:34:30.559913+0000","last_became_peered":"2024-03-08T21:34:30.559913+0000","last_unstale":"2024-03-08T21:34:32.821324+0000","last_undegraded":"2024-03-08T21:34:32.821324+0000","last_fullsized":"2024-03-08T21:34:32.821324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:23:44.306090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553487+0000","last_change":"2024-03-08T21:34:31.567893+0000","last_active":"2024-03-08T21:34:32.553487+0000","last_peered":"2024-03-08T21:34:32.553487+0000","last_clean":"2024-03-08T21:34:32.553487+0000","last_became_active":"2024-03-08T21:34:31.567686+0000","last_became_peered":"2024-03-08T21:34:31.567686+0000","last_unstale":"2024-03-08T21:34:32.553487+0000","last_undegraded":"2024-03-08T21:34:32.553487+0000","last_fullsized":"2024-03-08T21:34:32.553487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:29:01.664278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453072+0000","last_change":"2024-03-08T21:34:30.558965+0000","last_active":"2024-03-08T21:34:33.453072+0000","last_peered":"2024-03-08T21:34:33.453072+0000","last_clean":"2024-03-08T21:34:33.453072+0000","last_became_active":"2024-03-08T21:34:30.558733+0000","last_became_peered":"2024-03-08T21:34:30.558733+0000","last_unstale":"2024-03-08T21:34:33.453072+0000","last_undegraded":"2024-03-08T21:34:33.453072+0000","last_fullsized":"2024-03-08T21:34:33.453072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:49:39.894974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553126+0000","last_change":"2024-03-08T21:34:31.569142+0000","last_active":"2024-03-08T21:34:32.553126+0000","last_peered":"2024-03-08T21:34:32.553126+0000","last_clean":"2024-03-08T21:34:32.553126+0000","last_became_active":"2024-03-08T21:34:31.568593+0000","last_became_peered":"2024-03-08T21:34:31.568593+0000","last_unstale":"2024-03-08T21:34:32.553126+0000","last_undegraded":"2024-03-08T21:34:32.553126+0000","last_fullsized":"2024-03-08T21:34:32.553126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:16:16.910508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550865+0000","last_change":"2024-03-08T21:34:30.550256+0000","last_active":"2024-03-08T21:34:32.550865+0000","last_peered":"2024-03-08T21:34:32.550865+0000","last_clean":"2024-03-08T21:34:32.550865+0000","last_became_active":"2024-03-08T21:34:30.549932+0000","last_became_peered":"2024-03-08T21:34:30.549932+0000","last_unstale":"2024-03-08T21:34:32.550865+0000","last_undegraded":"2024-03-08T21:34:32.550865+0000","last_fullsized":"2024-03-08T21:34:32.550865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:23:04.872100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966713+0000","last_change":"2024-03-08T21:34:31.555063+0000","last_active":"2024-03-08T21:34:33.966713+0000","last_peered":"2024-03-08T21:34:33.966713+0000","last_clean":"2024-03-08T21:34:33.966713+0000","last_became_active":"2024-03-08T21:34:31.554685+0000","last_became_peered":"2024-03-08T21:34:31.554685+0000","last_unstale":"2024-03-08T21:34:33.966713+0000","last_undegraded":"2024-03-08T21:34:33.966713+0000","last_fullsized":"2024-03-08T21:34:33.966713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:23:58.415066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.965673+0000","last_change":"2024-03-08T21:34:30.543567+0000","last_active":"2024-03-08T21:34:33.965673+0000","last_peered":"2024-03-08T21:34:33.965673+0000","last_clean":"2024-03-08T21:34:33.965673+0000","last_became_active":"2024-03-08T21:34:30.543129+0000","last_became_peered":"2024-03-08T21:34:30.543129+0000","last_unstale":"2024-03-08T21:34:33.965673+0000","last_undegraded":"2024-03-08T21:34:33.965673+0000","last_fullsized":"2024-03-08T21:34:33.965673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.238862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.553411+0000","last_change":"2024-03-08T21:34:31.549004+0000","last_active":"2024-03-08T21:34:32.553411+0000","last_peered":"2024-03-08T21:34:32.553411+0000","last_clean":"2024-03-08T21:34:32.553411+0000","last_became_active":"2024-03-08T21:34:31.548739+0000","last_became_peered":"2024-03-08T21:34:31.548739+0000","last_unstale":"2024-03-08T21:34:32.553411+0000","last_undegraded":"2024-03-08T21:34:32.553411+0000","last_fullsized":"2024-03-08T21:34:32.553411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:23:09.738399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546418+0000","last_change":"2024-03-08T21:34:30.554333+0000","last_active":"2024-03-08T21:34:33.546418+0000","last_peered":"2024-03-08T21:34:33.546418+0000","last_clean":"2024-03-08T21:34:33.546418+0000","last_became_active":"2024-03-08T21:34:30.554055+0000","last_became_peered":"2024-03-08T21:34:30.554055+0000","last_unstale":"2024-03-08T21:34:33.546418+0000","last_undegraded":"2024-03-08T21:34:33.546418+0000","last_fullsized":"2024-03-08T21:34:33.546418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:31:30.814488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966890+0000","last_change":"2024-03-08T21:34:31.548419+0000","last_active":"2024-03-08T21:34:33.966890+0000","last_peered":"2024-03-08T21:34:33.966890+0000","last_clean":"2024-03-08T21:34:33.966890+0000","last_became_active":"2024-03-08T21:34:31.547838+0000","last_became_peered":"2024-03-08T21:34:31.547838+0000","last_unstale":"2024-03-08T21:34:33.966890+0000","last_undegraded":"2024-03-08T21:34:33.966890+0000","last_fullsized":"2024-03-08T21:34:33.966890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:44:46.793394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.544956+0000","last_change":"2024-03-08T21:34:30.558750+0000","last_active":"2024-03-08T21:34:33.544956+0000","last_peered":"2024-03-08T21:34:33.544956+0000","last_clean":"2024-03-08T21:34:33.544956+0000","last_became_active":"2024-03-08T21:34:30.558445+0000","last_became_peered":"2024-03-08T21:34:30.558445+0000","last_unstale":"2024-03-08T21:34:33.544956+0000","last_undegraded":"2024-03-08T21:34:33.544956+0000","last_fullsized":"2024-03-08T21:34:33.544956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T05:31:03.113547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821300+0000","last_change":"2024-03-08T21:34:31.550510+0000","last_active":"2024-03-08T21:34:32.821300+0000","last_peered":"2024-03-08T21:34:32.821300+0000","last_clean":"2024-03-08T21:34:32.821300+0000","last_became_active":"2024-03-08T21:34:31.550201+0000","last_became_peered":"2024-03-08T21:34:31.550201+0000","last_unstale":"2024-03-08T21:34:32.821300+0000","last_undegraded":"2024-03-08T21:34:32.821300+0000","last_fullsized":"2024-03-08T21:34:32.821300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:45:45.812558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.546063+0000","last_change":"2024-03-08T21:34:30.556754+0000","last_active":"2024-03-08T21:34:33.546063+0000","last_peered":"2024-03-08T21:34:33.546063+0000","last_clean":"2024-03-08T21:34:33.546063+0000","last_became_active":"2024-03-08T21:34:30.556424+0000","last_became_peered":"2024-03-08T21:34:30.556424+0000","last_unstale":"2024-03-08T21:34:33.546063+0000","last_undegraded":"2024-03-08T21:34:33.546063+0000","last_fullsized":"2024-03-08T21:34:33.546063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:07:49.087025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.453148+0000","last_change":"2024-03-08T21:34:31.562018+0000","last_active":"2024-03-08T21:34:33.453148+0000","last_peered":"2024-03-08T21:34:33.453148+0000","last_clean":"2024-03-08T21:34:33.453148+0000","last_became_active":"2024-03-08T21:34:31.561769+0000","last_became_peered":"2024-03-08T21:34:31.561769+0000","last_unstale":"2024-03-08T21:34:33.453148+0000","last_undegraded":"2024-03-08T21:34:33.453148+0000","last_fullsized":"2024-03-08T21:34:33.453148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:09:45.062648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821444+0000","last_change":"2024-03-08T21:34:30.552076+0000","last_active":"2024-03-08T21:34:32.821444+0000","last_peered":"2024-03-08T21:34:32.821444+0000","last_clean":"2024-03-08T21:34:32.821444+0000","last_became_active":"2024-03-08T21:34:30.551683+0000","last_became_peered":"2024-03-08T21:34:30.551683+0000","last_unstale":"2024-03-08T21:34:32.821444+0000","last_undegraded":"2024-03-08T21:34:32.821444+0000","last_fullsized":"2024-03-08T21:34:32.821444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T00:57:49.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.821387+0000","last_change":"2024-03-08T21:34:31.558159+0000","last_active":"2024-03-08T21:34:32.821387+0000","last_peered":"2024-03-08T21:34:32.821387+0000","last_clean":"2024-03-08T21:34:32.821387+0000","last_became_active":"2024-03-08T21:34:31.557912+0000","last_became_peered":"2024-03-08T21:34:31.557912+0000","last_unstale":"2024-03-08T21:34:32.821387+0000","last_undegraded":"2024-03-08T21:34:32.821387+0000","last_fullsized":"2024-03-08T21:34:32.821387+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T08:06:54.847854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.545803+0000","last_change":"2024-03-08T21:34:30.546866+0000","last_active":"2024-03-08T21:34:33.545803+0000","last_peered":"2024-03-08T21:34:33.545803+0000","last_clean":"2024-03-08T21:34:33.545803+0000","last_became_active":"2024-03-08T21:34:30.546612+0000","last_became_peered":"2024-03-08T21:34:30.546612+0000","last_unstale":"2024-03-08T21:34:33.545803+0000","last_undegraded":"2024-03-08T21:34:33.545803+0000","last_fullsized":"2024-03-08T21:34:33.545803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T04:20:21.764754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554075+0000","last_change":"2024-03-08T21:34:31.551536+0000","last_active":"2024-03-08T21:34:32.554075+0000","last_peered":"2024-03-08T21:34:32.554075+0000","last_clean":"2024-03-08T21:34:32.554075+0000","last_became_active":"2024-03-08T21:34:31.551080+0000","last_became_peered":"2024-03-08T21:34:31.551080+0000","last_unstale":"2024-03-08T21:34:32.554075+0000","last_undegraded":"2024-03-08T21:34:32.554075+0000","last_fullsized":"2024-03-08T21:34:32.554075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T07:39:19.388395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.551341+0000","last_change":"2024-03-08T21:34:30.545077+0000","last_active":"2024-03-08T21:34:32.551341+0000","last_peered":"2024-03-08T21:34:32.551341+0000","last_clean":"2024-03-08T21:34:32.551341+0000","last_became_active":"2024-03-08T21:34:30.544704+0000","last_became_peered":"2024-03-08T21:34:30.544704+0000","last_unstale":"2024-03-08T21:34:32.551341+0000","last_undegraded":"2024-03-08T21:34:32.551341+0000","last_fullsized":"2024-03-08T21:34:32.551341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:39:52.000503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.550868+0000","last_change":"2024-03-08T21:34:31.558028+0000","last_active":"2024-03-08T21:34:32.550868+0000","last_peered":"2024-03-08T21:34:32.550868+0000","last_clean":"2024-03-08T21:34:32.550868+0000","last_became_active":"2024-03-08T21:34:31.551210+0000","last_became_peered":"2024-03-08T21:34:31.551210+0000","last_unstale":"2024-03-08T21:34:32.550868+0000","last_undegraded":"2024-03-08T21:34:32.550868+0000","last_fullsized":"2024-03-08T21:34:32.550868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T03:45:45.812558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:32.554018+0000","last_change":"2024-03-08T21:34:30.541268+0000","last_active":"2024-03-08T21:34:32.554018+0000","last_peered":"2024-03-08T21:34:32.554018+0000","last_clean":"2024-03-08T21:34:32.554018+0000","last_became_active":"2024-03-08T21:34:30.541005+0000","last_became_peered":"2024-03-08T21:34:30.541005+0000","last_unstale":"2024-03-08T21:34:32.554018+0000","last_undegraded":"2024-03-08T21:34:32.554018+0000","last_fullsized":"2024-03-08T21:34:32.554018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T01:50:05.238862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966829+0000","last_change":"2024-03-08T21:34:31.552002+0000","last_active":"2024-03-08T21:34:33.966829+0000","last_peered":"2024-03-08T21:34:33.966829+0000","last_clean":"2024-03-08T21:34:33.966829+0000","last_became_active":"2024-03-08T21:34:31.551710+0000","last_became_peered":"2024-03-08T21:34:31.551710+0000","last_unstale":"2024-03-08T21:34:33.966829+0000","last_undegraded":"2024-03-08T21:34:33.966829+0000","last_fullsized":"2024-03-08T21:34:33.966829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:30.519591+0000","last_clean_scrub_stamp":"2024-03-08T21:34:30.519591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T22:45:29.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.452862+0000","last_change":"2024-03-08T21:34:30.553385+0000","last_active":"2024-03-08T21:34:33.452862+0000","last_peered":"2024-03-08T21:34:33.452862+0000","last_clean":"2024-03-08T21:34:33.452862+0000","last_became_active":"2024-03-08T21:34:30.553114+0000","last_became_peered":"2024-03-08T21:34:30.553114+0000","last_unstale":"2024-03-08T21:34:33.452862+0000","last_undegraded":"2024-03-08T21:34:33.452862+0000","last_fullsized":"2024-03-08T21:34:33.452862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:34:29.510288+0000","last_clean_scrub_stamp":"2024-03-08T21:34:29.510288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T02:07:49.087025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-03-08T21:34:33.966284+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:33.966284+0000","last_peered":"2024-03-08T21:34:33.966284+0000","last_clean":"2024-03-08T21:34:33.966284+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:33.966284+0000","last_undegraded":"2024-03-08T21:34:33.966284+0000","last_fullsized":"2024-03-08T21:34:33.966284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":925696,"data_stored":715723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":125881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":125937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":126899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":126899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":125369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":921600,"data_stored":715633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-08T21:34:40.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-08T21:34:40.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 Processor -- start 2024-03-08T21:34:40.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 -- start start 2024-03-08T21:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fda280b3fc0 0x7fda2809deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 0x7fda2814e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2809b680 con 0x7fda2809e3f0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280adef0 con 0x7fda280b3fc0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda2de00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280ae1d0 con 0x7fda280b4b80 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda1e000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fda2809e3f0 0x7fda28143c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46592/0 (socket says 172.21.15.119:46592) 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda1e000640 1 -- 172.21.15.119:0/2723587026 learned_addr learned my addr 172.21.15.119:0/2723587026 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26a00640 1 --2- 172.21.15.119:0/2723587026 >> v2:172.21.15.160:3300/0 conn(0x7fda280b3fc0 0x7fda2809deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda27400640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 0x7fda2814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26000640 1 -- 172.21.15.119:0/2723587026 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520848436 0 0) 0x7fda2809b680 con 0x7fda2809e3f0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26000640 1 -- 172.21.15.119:0/2723587026 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c003530 con 0x7fda2809e3f0 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26a00640 1 -- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 msgr2=0x7fda2814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26a00640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 0x7fda2814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26a00640 1 -- 172.21.15.119:0/2723587026 >> v1:172.21.15.119:6789/0 conn(0x7fda2809e3f0 legacy=0x7fda28143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda26a00640 1 -- 172.21.15.119:0/2723587026 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28144370 con 0x7fda280b3fc0 2024-03-08T21:34:40.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.636+0000 7fda27400640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 0x7fda2814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:40.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda26a00640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda2809deb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fda180097c0 tx=0x7fda1801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2109497e4d4b5d9b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda26000640 1 -- 172.21.15.119:0/2723587026 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180b0070 con 0x7fda280b3fc0 2024-03-08T21:34:40.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda26000640 1 -- 172.21.15.119:0/2723587026 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda180ab600 con 0x7fda280b3fc0 2024-03-08T21:34:40.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda26000640 1 -- 172.21.15.119:0/2723587026 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180ab9d0 con 0x7fda280b3fc0 2024-03-08T21:34:40.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 -- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 msgr2=0x7fda2809deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda2809deb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fda180097c0 tx=0x7fda1801c380 comp rx=0 tx=0).stop 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 -- 172.21.15.119:0/2723587026 shutdown_connections 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda280b4b80 0x7fda2814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 --2- 172.21.15.119:0/2723587026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda2809deb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 -- 172.21.15.119:0/2723587026 >> 172.21.15.119:0/2723587026 conn(0x7fda280b4fb0 msgr2=0x7fda280b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 -- 172.21.15.119:0/2723587026 shutdown_connections 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.640+0000 7fda2de00640 1 -- 172.21.15.119:0/2723587026 wait complete. 2024-03-08T21:34:40.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 Processor -- start 2024-03-08T21:34:40.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- start start 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda2809e3f0 0x7fda2813d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda281df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b2eb0 con 0x7fda280b4b80 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28073320 con 0x7fda280b3fc0 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b3030 con 0x7fda2809e3f0 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52494/0 (socket says 172.21.15.119:52494) 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 -- 172.21.15.119:0/1708820816 learned_addr learned my addr 172.21.15.119:0/1708820816 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:40.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda26a00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda2809e3f0 0x7fda2813d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda1e000640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda281df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 -- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda2809e3f0 msgr2=0x7fda2813d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda2809e3f0 0x7fda2813d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 -- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 msgr2=0x7fda281df3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda281df3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 -- 172.21.15.119:0/1708820816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2814e010 con 0x7fda280b4b80 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda27400640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ef90 tx=0x7fda20009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20018020 con 0x7fda280b4b80 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20014480 con 0x7fda280b4b80 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20014870 con 0x7fda280b4b80 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2813c640 con 0x7fda280b4b80 2024-03-08T21:34:40.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2813cb40 con 0x7fda280b4b80 2024-03-08T21:34:40.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.644+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28141980 con 0x7fda280b4b80 2024-03-08T21:34:40.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.648+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fda2001b020 con 0x7fda280b4b80 2024-03-08T21:34:40.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.648+0000 7fda1fe00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 0x7fda04069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:40.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.648+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda20086450 con 0x7fda280b4b80 2024-03-08T21:34:40.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.648+0000 7fda26a00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 0x7fda04069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:40.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.648+0000 7fda26a00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 0x7fda04069b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda180ad000 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:40.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.652+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fda20022030 con 0x7fda280b4b80 2024-03-08T21:34:40.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.860+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fda28067db0 con 0x7fda280b4b80 2024-03-08T21:34:40.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.864+0000 7fda1fe00640 1 -- 172.21.15.119:0/1708820816 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fda20010040 con 0x7fda280b4b80 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQAChOtlvC0jDxAA1g3YPVNdL51JtIDGrFOacQ== 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stdout: caps mds = "allow" 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stdout: caps mon = "allow r" 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-08T21:34:40.854 INFO:teuthology.orchestra.run.smithi119.stderr:updated caps for client.0 2024-03-08T21:34:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 msgr2=0x7fda04069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 0x7fda04069b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fda180ad000 tx=0x7fda18008040 comp rx=0 tx=0).stop 2024-03-08T21:34:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 msgr2=0x7fda2813b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ef90 tx=0x7fda20009f90 comp rx=0 tx=0).stop 2024-03-08T21:34:40.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 shutdown_connections 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fda04067690 0x7fda04069b50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda280b4b80 0x7fda2813b870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda280b3fc0 0x7fda281df3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 --2- 172.21.15.119:0/1708820816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda2809e3f0 0x7fda2813d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 >> 172.21.15.119:0/1708820816 conn(0x7fda280b4fb0 msgr2=0x7fda2809d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 shutdown_connections 2024-03-08T21:34:40.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:40.868+0000 7fda2de00640 1 -- 172.21.15.119:0/1708820816 wait complete. 2024-03-08T21:34:40.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:41.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 Processor -- start 2024-03-08T21:34:41.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 -- start start 2024-03-08T21:34:41.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040b4fb0 0x7f56040b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f560414bb00 0x7f560414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560414c4d0 con 0x7f56040b5390 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560409d5d0 con 0x7f560414bb00 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f560ae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040b3940 con 0x7f56040b4fb0 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f560414bb00 0x7f560414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5603e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040b4fb0 0x7f56040b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f560414bb00 0x7f560414bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:32850/0 (socket says 172.21.15.119:32850) 2024-03-08T21:34:41.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 -- 172.21.15.119:0/1880951540 learned_addr learned my addr 172.21.15.119:0/1880951540 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 -- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040b4fb0 msgr2=0x7f56040b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 --2- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040b4fb0 0x7f56040b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 -- 172.21.15.119:0/1880951540 >> v1:172.21.15.160:6789/0 conn(0x7f56040b5390 legacy=0x7f560409cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5608e00640 1 -- 172.21.15.119:0/1880951540 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040b3c20 con 0x7f560414bb00 2024-03-08T21:34:41.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.020+0000 7f5602a00640 1 -- 172.21.15.119:0/1880951540 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698775224 0 0) 0x7f560414c4d0 con 0x7f56040b5390 2024-03-08T21:34:41.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f5608e00640 1 --2- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f560414bb00 0x7f560414bf90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32b778768bd5695 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f5602a00640 1 -- 172.21.15.119:0/1880951540 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b0070 con 0x7f560414bb00 2024-03-08T21:34:41.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f5602a00640 1 -- 172.21.15.119:0/1880951540 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc004230 con 0x7f560414bb00 2024-03-08T21:34:41.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f5602a00640 1 -- 172.21.15.119:0/1880951540 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc003620 con 0x7f560414bb00 2024-03-08T21:34:41.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 -- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f560414bb00 msgr2=0x7f560414bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 --2- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f560414bb00 0x7f560414bf90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc01c440 comp rx=0 tx=0).stop 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 -- 172.21.15.119:0/1880951540 shutdown_connections 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 --2- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f560414bb00 0x7f560414bf90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 --2- 172.21.15.119:0/1880951540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040b4fb0 0x7f56040b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 -- 172.21.15.119:0/1880951540 >> 172.21.15.119:0/1880951540 conn(0x7f560406c620 msgr2=0x7f560406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 -- 172.21.15.119:0/1880951540 shutdown_connections 2024-03-08T21:34:41.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.024+0000 7f560ae00640 1 -- 172.21.15.119:0/1880951540 wait complete. 2024-03-08T21:34:41.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 Processor -- start 2024-03-08T21:34:41.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- start start 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56040b4fb0 0x7f56040b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f560414bb00 0x7f56040b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604158820 con 0x7f56040b5390 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56041586a0 con 0x7f56040b4fb0 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56041589a0 con 0x7f560414bb00 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52504/0 (socket says 172.21.15.119:52504) 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 -- 172.21.15.119:0/158191374 learned_addr learned my addr 172.21.15.119:0/158191374 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5608e00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f560414bb00 0x7f56040b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603e00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56040b4fb0 0x7f56040b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 -- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f560414bb00 msgr2=0x7f56040b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f560414bb00 0x7f56040b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 -- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56040b4fb0 msgr2=0x7f56040b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56040b4fb0 0x7f56040b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 -- 172.21.15.119:0/158191374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040b1d60 con 0x7f56040b5390 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f5603400640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c480 tx=0x7f55f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0005480 con 0x7f56040b5390 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f0003600 con 0x7f56040b5390 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f00039f0 con 0x7f56040b5390 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560414f510 con 0x7f56040b5390 2024-03-08T21:34:41.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560414e840 con 0x7f56040b5390 2024-03-08T21:34:41.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.028+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604067db0 con 0x7f56040b5390 2024-03-08T21:34:41.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.032+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f55f0003b90 con 0x7f56040b5390 2024-03-08T21:34:41.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.032+0000 7f55fbe00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 0x7f55e4069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.032+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55f0085450 con 0x7f56040b5390 2024-03-08T21:34:41.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.032+0000 7f5603e00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 0x7f55e4069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.032+0000 7f5603e00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 0x7f55e4069b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55f4011340 tx=0x7f55f400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.036+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f55f0055a70 con 0x7f56040b5390 2024-03-08T21:34:41.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.220+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f560414a6b0 con 0x7f56040b5390 2024-03-08T21:34:41.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.220+0000 7f55fbe00640 1 -- 172.21.15.119:0/158191374 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7f55f0059b10 con 0x7f56040b5390 2024-03-08T21:34:41.211 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:41.211 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:41.211 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:41.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 msgr2=0x7f55e4069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 0x7f55e4069b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55f4011340 tx=0x7f55f400b040 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 msgr2=0x7f56040b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c480 tx=0x7f55f000c940 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 shutdown_connections 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f55e4067690 0x7f55e4069b50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f560414bb00 0x7f56040b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f56040b5390 0x7f56040b0a10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 --2- 172.21.15.119:0/158191374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56040b4fb0 0x7f56040b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 >> 172.21.15.119:0/158191374 conn(0x7f560406c620 msgr2=0x7f5604149a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 shutdown_connections 2024-03-08T21:34:41.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.224+0000 7f560ae00640 1 -- 172.21.15.119:0/158191374 wait complete. 2024-03-08T21:34:41.432 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T21:34:30.907729+0000', 'modified': '2024-03-08T21:34:33.932128+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5007}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5007': {'gid': 5007, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6835/3038640532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 3038640532}, {'type': 'v1', 'addr': '172.21.15.119:6835', 'nonce': 3038640532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-08T21:34:41.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T21:34:41.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-08T21:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 Processor -- start 2024-03-08T21:34:41.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 -- start start 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24409adb0 0x7fe24409cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe244072fe0 0x7fe2441441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe2441446e0 0x7fe24413d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24409b190 con 0x7fe244072fe0 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24409d240 con 0x7fe2441446e0 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe249400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24409d520 con 0x7fe24409adb0 2024-03-08T21:34:41.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.580+0000 7fe239e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe244072fe0 0x7fe2441441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe244072fe0 0x7fe2441441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52506/0 (socket says 172.21.15.119:52506) 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 -- 172.21.15.119:0/1350620382 learned_addr learned my addr 172.21.15.119:0/1350620382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe242800640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24409adb0 0x7fe24409cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe243200640 1 --2- 172.21.15.119:0/1350620382 >> v2:172.21.15.160:3300/0 conn(0x7fe2441446e0 0x7fe24413d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 -- 172.21.15.119:0/1350620382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24409adb0 msgr2=0x7fe24409cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24409adb0 0x7fe24409cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 -- 172.21.15.119:0/1350620382 >> v2:172.21.15.160:3300/0 conn(0x7fe2441446e0 msgr2=0x7fe24413d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 --2- 172.21.15.119:0/1350620382 >> v2:172.21.15.160:3300/0 conn(0x7fe2441446e0 0x7fe24413d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 -- 172.21.15.119:0/1350620382 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244144af0 con 0x7fe244072fe0 2024-03-08T21:34:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe239e00640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe244072fe0 0x7fe2441441a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe244141840 tx=0x7fe23401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba01415de8d2cb28 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe241e00640 1 -- 172.21.15.119:0/1350620382 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340ab640 con 0x7fe244072fe0 2024-03-08T21:34:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe241e00640 1 -- 172.21.15.119:0/1350620382 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340b0070 con 0x7fe244072fe0 2024-03-08T21:34:41.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.584+0000 7fe241e00640 1 -- 172.21.15.119:0/1350620382 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340aba00 con 0x7fe244072fe0 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/1350620382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe244072fe0 msgr2=0x7fe2441441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe244072fe0 0x7fe2441441a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe244141840 tx=0x7fe23401c4c0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/1350620382 shutdown_connections 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- 172.21.15.119:0/1350620382 >> v2:172.21.15.160:3300/0 conn(0x7fe2441446e0 0x7fe24413d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe244072fe0 0x7fe2441441a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- 172.21.15.119:0/1350620382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe24409adb0 0x7fe24409cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/1350620382 >> 172.21.15.119:0/1350620382 conn(0x7fe24406c620 msgr2=0x7fe24406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/1350620382 shutdown_connections 2024-03-08T21:34:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/1350620382 wait complete. 2024-03-08T21:34:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 Processor -- start 2024-03-08T21:34:41.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- start start 2024-03-08T21:34:41.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 0x7fe2440b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 0x7fe2441451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe244147bd0 con 0x7fe24409adb0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe244147a50 con 0x7fe244072fe0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe244147d50 con 0x7fe2441446e0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52514/0 (socket says 172.21.15.119:52514) 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 -- 172.21.15.119:0/3371998210 learned_addr learned my addr 172.21.15.119:0/3371998210 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe243200640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 0x7fe2441451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe242800640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 0x7fe2440b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 -- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 msgr2=0x7fe2441451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 0x7fe2441451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 -- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 msgr2=0x7fe2440b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 0x7fe2440b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 -- 172.21.15.119:0/3371998210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244146410 con 0x7fe24409adb0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe243200640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 0x7fe2441451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe242800640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 0x7fe2440b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe239e00640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe23401c9a0 tx=0x7fe23401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe23b400640 1 -- 172.21.15.119:0/3371998210 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340abdd0 con 0x7fe24409adb0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe23b400640 1 -- 172.21.15.119:0/3371998210 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340be3f0 con 0x7fe24409adb0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2441466f0 con 0x7fe24409adb0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.588+0000 7fe23b400640 1 -- 172.21.15.119:0/3371998210 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340be7e0 con 0x7fe24409adb0 2024-03-08T21:34:41.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe244144e10 con 0x7fe24409adb0 2024-03-08T21:34:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe23b400640 1 -- 172.21.15.119:0/3371998210 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fe2340b43f0 con 0x7fe24409adb0 2024-03-08T21:34:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe23b400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 0x7fe220069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe23b400640 1 -- 172.21.15.119:0/3371998210 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe23411f910 con 0x7fe24409adb0 2024-03-08T21:34:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe242800640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 0x7fe220069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe24c7e4000 1 Processor -- start 2024-03-08T21:34:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe24c7e4000 1 -- start start 2024-03-08T21:34:41.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.592+0000 7fe242800640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 0x7fe220069b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00bc60 tx=0x7fe22c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671065710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710a3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670f4f420 con 0x55a671065c50 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670eb6fa0 con 0x55a671065330 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a670e3ee00 con 0x55a671066570 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52516/0 (socket says 172.21.15.119:52516) 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 -- 172.21.15.119:0/2227768058 learned_addr learned my addr 172.21.15.119:0/2227768058 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe242800640 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671065710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe243200640 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 -- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 msgr2=0x55a6710a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 -- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 msgr2=0x55a671065710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671065710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 -- 172.21.15.119:0/2227768058 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a670e42cc0 con 0x55a671065c50 2024-03-08T21:34:41.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2340efd80 tx=0x7fe2340192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5752532ade5c6b99 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe233400640 1 -- 172.21.15.119:0/2227768058 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340f4e60 con 0x55a671065c50 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe233400640 1 -- 172.21.15.119:0/2227768058 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340b0050 con 0x55a671065c50 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe233400640 1 -- 172.21.15.119:0/2227768058 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340f3f40 con 0x55a671065c50 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- 172.21.15.119:0/2227768058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 msgr2=0x55a671066030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe2340efd80 tx=0x7fe2340192c0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- 172.21.15.119:0/2227768058 shutdown_connections 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671066030 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/2227768058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671065710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- 172.21.15.119:0/2227768058 >> 172.21.15.119:0/2227768058 conn(0x55a671097170 msgr2=0x55a671099590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- 172.21.15.119:0/2227768058 shutdown_connections 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- 172.21.15.119:0/2227768058 wait complete. 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- start start 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 Processor -- start 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671065330 0x55a671095f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671066570 0x55a671097a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670eb3040 con 0x55a671065c50 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670ebb5d0 con 0x55a671066570 2024-03-08T21:34:41.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a670f4f420 con 0x55a671065330 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe24c7e4000 10 client.0 _ll_register_callbacks cb 0x55a670e58ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52524/0 (socket says 172.21.15.119:52524) 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe239e00640 1 -- 172.21.15.119:0/4094851118 learned_addr learned my addr 172.21.15.119:0/4094851118 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe243200640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671066570 0x55a671097a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.596+0000 7fe242800640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671065330 0x55a671095f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 -- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671065330 msgr2=0x55a671095f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671065330 0x55a671095f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 -- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671066570 msgr2=0x55a671097a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671066570 0x55a671097a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 -- 172.21.15.119:0/4094851118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a670e7b380 con 0x55a671065c50 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe239e00640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe23401ca30 tx=0x7fe2340abf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923aba1e523cddb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23410c060 con 0x55a671065c50 2024-03-08T21:34:41.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2340ec460 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2340b0050 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe234113050 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 10 client.5205 fetch_fsmap learned FSMap version 17 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a670e8a830 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340b0050 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 17) v1 ==== 2144+0+0 (secure 0 0 0) 0x7fe2340f8070 con 0x55a671065c50 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 10 client.5205 fetch_fsmap finished waiting for FSMap version 17 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 10 client.5205 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 20 client.5205 populate_metadata read hostname 'smithi119' 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710984a0 0x55a671098880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 4 client.5205 mds_command: new command op to 5007 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 --> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a670e52b60 con 0x55a6710984a0 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe242800640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710984a0 0x55a671098880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 10 client.5205 ms_handle_connect on v2:172.21.15.119:6834/3038640532 2024-03-08T21:34:41.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe242800640 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710984a0 0x55a671098880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962bc6714f35d6e4 server_cookie=601a531b402481a0 in_seq=0 out_seq=0 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 1 -- 172.21.15.119:0/4094851118 <== mds.0 v2:172.21.15.119:6834/3038640532 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a670e52b60 con 0x55a6710984a0 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 10 client.5205 handle_command_reply: tid=0 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 client.5205 shutdown 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 msgr2=0x55a671097550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe23401ca30 tx=0x7fe2340abf90 comp rx=0 tx=0).stop 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 shutdown_connections 2024-03-08T21:34:41.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710984a0 0x55a671098880 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671066570 0x55a671097a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671097550 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe227e00640 0 client.5205 ms_handle_reset on v2:172.21.15.119:6834/3038640532 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/4094851118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671065330 0x55a671095f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 >> 172.21.15.119:0/4094851118 conn(0x55a671097170 msgr2=0x55a671064a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 shutdown_connections 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 1 -- 172.21.15.119:0/4094851118 wait complete. 2024-03-08T21:34:41.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.600+0000 7fe24c7e4000 20 client.5205 trim_cache size 0 max 16384 2024-03-08T21:34:41.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 Processor -- start 2024-03-08T21:34:41.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 -- start start 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671068960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2441ec1d0 con 0x55a671065c50 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2441eb4e0 con 0x55a671065330 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a670f72b80 con 0x55a671066570 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52534/0 (socket says 172.21.15.119:52534) 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 -- 172.21.15.119:0/49396843 learned_addr learned my addr 172.21.15.119:0/49396843 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe243200640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe242800640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 -- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 msgr2=0x55a6710693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 -- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 msgr2=0x55a671068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671068960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 -- 172.21.15.119:0/49396843 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a670e84fb0 con 0x55a671065c50 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe243200640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe242800640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.616+0000 7fe239e00640 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe2340ec700 tx=0x7fe234119040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d5c2c40a780062 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe232a00640 1 -- 172.21.15.119:0/49396843 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340f4e60 con 0x55a671065c50 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe232a00640 1 -- 172.21.15.119:0/49396843 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340b0070 con 0x55a671065c50 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe232a00640 1 -- 172.21.15.119:0/49396843 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340f8500 con 0x55a671065c50 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/49396843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 msgr2=0x55a671068ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe2340ec700 tx=0x7fe234119040 comp rx=0 tx=0).stop 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/49396843 shutdown_connections 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065c50 0x55a671068ea0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/49396843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065330 0x55a671068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/49396843 >> 172.21.15.119:0/49396843 conn(0x55a671097170 msgr2=0x55a671095d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/49396843 shutdown_connections 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/49396843 wait complete. 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- start start 2024-03-08T21:34:41.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 Processor -- start 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065c50 0x55a6710ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670e5c970 con 0x55a671065330 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a670e7a850 con 0x55a671065c50 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a670eb62b0 con 0x55a671066570 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 10 client.0 _ll_register_callbacks cb 0x55a671034150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52540/0 (socket says 172.21.15.119:52540) 2024-03-08T21:34:41.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 -- 172.21.15.119:0/3538115223 learned_addr learned my addr 172.21.15.119:0/3538115223 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe239e00640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065c50 0x55a6710ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe243200640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 -- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 msgr2=0x55a6710ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 -- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065c50 msgr2=0x55a6710ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065c50 0x55a6710ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 -- 172.21.15.119:0/3538115223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a670f382e0 con 0x55a671065330 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe242800640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00fbd0 tx=0x7fe22c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd24b851172a880 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe227e00640 10 client.0 ms_handle_connect on v2:172.21.15.119:3300/0 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c02a820 con 0x55a671065330 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mon.0 v2:172.21.15.119:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe22c01f8b0 con 0x55a671065330 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2340b0070 con 0x55a671065330 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe22c039050 con 0x55a671065330 2024-03-08T21:34:41.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 10 client.5211 fetch_fsmap learned FSMap version 17 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a670e5e0a0 con 0x55a671065330 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.620+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mon.0 v2:172.21.15.119:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340b0070 con 0x55a671065330 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mon.0 v2:172.21.15.119:3300/0 5 ==== fsmap(e 17) v1 ==== 2144+0+0 (secure 0 0 0) 0x7fe22c03c020 con 0x55a671065330 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 10 client.5211 fetch_fsmap finished waiting for FSMap version 17 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 10 client.5211 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 20 client.5211 populate_metadata read hostname 'smithi119' 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710cebe0 0x55a671105490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 4 client.5211 mds_command: new command op to 5007 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 --> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a670ec44e0 con 0x55a6710cebe0 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe239e00640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710cebe0 0x55a671105490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe239e00640 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710cebe0 0x55a671105490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8306c17a552a320 server_cookie=68dc6bbe1adb12ba in_seq=0 out_seq=0 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe227e00640 10 client.5211 ms_handle_connect on v2:172.21.15.119:6834/3038640532 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe227e00640 1 -- 172.21.15.119:0/3538115223 <== mds.0 v2:172.21.15.119:6834/3038640532 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a670ec44e0 con 0x55a6710cebe0 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe227e00640 10 client.5211 handle_command_reply: tid=0 2024-03-08T21:34:41.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 client.5211 shutdown 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 msgr2=0x55a67106b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00fbd0 tx=0x7fe22c0046d0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 shutdown_connections 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:6834/3038640532,v1:172.21.15.119:6835/3038640532] conn(0x55a6710cebe0 0x55a671105490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a671066570 0x55a6710ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a671065c50 0x55a6710ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 --2- 172.21.15.119:0/3538115223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55a671065330 0x55a67106b070 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe227e00640 0 client.5211 ms_handle_reset on v2:172.21.15.119:6834/3038640532 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 >> 172.21.15.119:0/3538115223 conn(0x55a671097170 msgr2=0x55a671063a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 shutdown_connections 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 1 -- 172.21.15.119:0/3538115223 wait complete. 2024-03-08T21:34:41.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe24c7e4000 20 client.5211 trim_cache size 0 max 16384 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "cluster_fsid": "b59e109d-7f9b-46a7-b423-bd44b3e2407a", 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "whoami": 0, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 5007, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "want_state": "up:active", 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "state": "up:active", 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs", 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "rank_uptime": 10.098328104, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "mdsmap_epoch": 17, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch": 30, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_epoch_barrier": 30, 2024-03-08T21:34:41.619 INFO:teuthology.orchestra.run.smithi119.stdout: "uptime": 17.988194020000002 2024-03-08T21:34:41.620 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:41.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 msgr2=0x7fe220069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 0x7fe220069b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00bc60 tx=0x7fe22c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 msgr2=0x7fe2441d65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe23401c9a0 tx=0x7fe23401ad60 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 shutdown_connections 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fe220067690 0x7fe220069b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2441446e0 0x7fe2441451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe24409adb0 0x7fe2441d65a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 --2- 172.21.15.119:0/3371998210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe244072fe0 0x7fe2440b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 >> 172.21.15.119:0/3371998210 conn(0x7fe24406c620 msgr2=0x7fe24406ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 shutdown_connections 2024-03-08T21:34:41.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.624+0000 7fe249400640 1 -- 172.21.15.119:0/3371998210 wait complete. 2024-03-08T21:34:41.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T21:34:41.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 Processor -- start 2024-03-08T21:34:41.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 -- start start 2024-03-08T21:34:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f90d8147370 0x7f90d81477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d80b7d10 con 0x7f90d80b7930 2024-03-08T21:34:41.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d806d6b0 con 0x7f90d8147cf0 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90dcc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80b8820 con 0x7f90d8147370 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90d7400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f90d80b7930 0x7f90d80b4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:46598/0 (socket says 172.21.15.119:46598) 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.776+0000 7f90d7400640 1 -- 172.21.15.119:0/3615208323 learned_addr learned my addr 172.21.15.119:0/3615208323 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6a00640 1 --2- 172.21.15.119:0/3615208323 >> v2:172.21.15.119:3300/0 conn(0x7f90d8147370 0x7f90d81477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6000640 1 -- 172.21.15.119:0/3615208323 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104003974 0 0) 0x7f90d80b7d10 con 0x7f90d80b7930 2024-03-08T21:34:41.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6000640 1 -- 172.21.15.119:0/3615208323 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90bc003530 con 0x7f90d80b7930 2024-03-08T21:34:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6a00640 1 -- 172.21.15.119:0/3615208323 >> v1:172.21.15.160:6789/0 conn(0x7f90d8147cf0 legacy=0x7f90d8151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6a00640 1 -- 172.21.15.119:0/3615208323 >> v1:172.21.15.119:6789/0 conn(0x7f90d80b7930 legacy=0x7f90d80b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6a00640 1 -- 172.21.15.119:0/3615208323 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d806cf40 con 0x7f90d8147370 2024-03-08T21:34:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6a00640 1 --2- 172.21.15.119:0/3615208323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d81477b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b89a0 tx=0x7f90c401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9048274aa4d8c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6000640 1 -- 172.21.15.119:0/3615208323 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40b0070 con 0x7f90d8147370 2024-03-08T21:34:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6000640 1 -- 172.21.15.119:0/3615208323 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c40ab600 con 0x7f90d8147370 2024-03-08T21:34:41.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.780+0000 7f90d6000640 1 -- 172.21.15.119:0/3615208323 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40ab9d0 con 0x7f90d8147370 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3615208323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 msgr2=0x7f90d81477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3615208323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d81477b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b89a0 tx=0x7f90c401c410 comp rx=0 tx=0).stop 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3615208323 shutdown_connections 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3615208323 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d81477b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3615208323 >> 172.21.15.119:0/3615208323 conn(0x7f90d806b490 msgr2=0x7f90d80b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3615208323 shutdown_connections 2024-03-08T21:34:41.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3615208323 wait complete. 2024-03-08T21:34:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 Processor -- start 2024-03-08T21:34:41.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- start start 2024-03-08T21:34:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80b7930 0x7f90d8145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 0x7f90d80af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b9d30 con 0x7f90d8147370 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b98c0 con 0x7f90d8147cf0 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b82e0 con 0x7f90d80b7930 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:52556/0 (socket says 172.21.15.119:52556) 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 -- 172.21.15.119:0/3266288920 learned_addr learned my addr 172.21.15.119:0/3266288920 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 -- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80b7930 msgr2=0x7f90d8145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80b7930 0x7f90d8145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 -- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 msgr2=0x7f90d80af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d7e00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 0x7f90d80af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 0x7f90d80af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 -- 172.21.15.119:0/3266288920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80ae8e0 con 0x7f90d8147370 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d7e00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 0x7f90d80af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:41.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90d6a00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f90c40ae040 tx=0x7f90c40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40b0040 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c40b9070 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40b4690 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d80ac960 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.784+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d80aee40 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d80750f0 con 0x7f90d8147370 2024-03-08T21:34:41.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f90c40b4830 con 0x7f90d8147370 2024-03-08T21:34:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90cf400640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 0x7f90b8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c411f5b0 con 0x7f90d8147370 2024-03-08T21:34:41.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90d7400640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 0x7f90b8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:41.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.788+0000 7f90d7400640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 0x7f90b8069b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b8e80 tx=0x7f90c80016a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:41.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.792+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f90d80ae8e0 con 0x7f90d8147370 2024-03-08T21:34:41.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.980+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90d81477f0 con 0x7f90d8147370 2024-03-08T21:34:41.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.980+0000 7f90cf400640 1 -- 172.21.15.119:0/3266288920 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f90c4016090 con 0x7f90d8147370 2024-03-08T21:34:41.971 INFO:teuthology.orchestra.run.smithi119.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 msgr2=0x7f90b8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 0x7f90b8069b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b8e80 tx=0x7f90c80016a0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 msgr2=0x7f90d80ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f90c40ae040 tx=0x7f90c40191b0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 shutdown_connections 2024-03-08T21:34:41.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f90b8067660 0x7f90b8069b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90d8147cf0 0x7f90d80af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90d8147370 0x7f90d80ae3a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 --2- 172.21.15.119:0/3266288920 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80b7930 0x7f90d8145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 >> 172.21.15.119:0/3266288920 conn(0x7f90d806b490 msgr2=0x7f90d8146c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 shutdown_connections 2024-03-08T21:34:41.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:41.984+0000 7f90dcc00640 1 -- 172.21.15.119:0/3266288920 wait complete. 2024-03-08T21:34:41.991 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T21:34:41.992 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T21:34:41.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:41.992 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2024-03-08T21:34:42.001 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T21:34:42.001 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T21:34:42.001 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T21:34:42.001 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.001 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-08T21:34:42.002 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:37:09:31:94 brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T21:34:42.003 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:42.004 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-03-08T21:34:42.004 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2024-03-08T21:34:42.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.005 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T21:34:42.064 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-03-08T21:34:42.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.067 DEBUG:teuthology.orchestra.run.smithi119:> route 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-08T21:34:42.122 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T21:34:42.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-08T21:34:42.123 DEBUG:teuthology.orchestra.run.smithi119:> ') 2024-03-08T21:34:42.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.215 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-03-08T21:34:42.223 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T21:34:42.223 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T21:34:42.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.224 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2024-03-08T21:34:42.286 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-08T21:34:42.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T21:34:42.287 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:42.335 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-08T21:34:42.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T21:34:42.335 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:42.382 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-03-08T21:34:42.443 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T21:34:42.496 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-03-08T21:34:42.496 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-03-08T21:34:42.496 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T21:34:42.497 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysusers.service 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-03-08T21:34:42.498 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:42.499 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:42.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.500 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-03-08T21:34:42.551 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-08T21:34:42.551 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-08T21:34:42.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2024-03-08T21:34:42.613 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2024-03-08T21:34:42.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/run/lock 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2024-03-08T21:34:42.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/fs/nfsd 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/credentials/systemd-sysusers.service 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/rpc_pipefs 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-0 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-1 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-2 2024-03-08T21:34:42.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph/osd/ceph-3 2024-03-08T21:34:42.667 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2024-03-08T21:34:42.667 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:42.667 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:42.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.668 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2024-03-08T21:34:42.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2024-03-08T21:34:42.696+0000 7f987918c580 -1 init, newargv = 0x55fd29b23430 newargc=15 2024-03-08T21:34:42.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[36789]: starting ceph client 2024-03-08T21:34:42.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[36789]: starting fuse 2024-03-08T21:34:42.694 INFO:teuthology.orchestra.run.smithi119.stdout:43 2024-03-08T21:34:42.694 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-08T21:34:42.694 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> import re 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> import os 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2024-03-08T21:34:42.695 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> return f 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2024-03-08T21:34:42.696 DEBUG:teuthology.orchestra.run.smithi119:> ' 2024-03-08T21:34:42.814 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.36789.asok 2024-03-08T21:34:42.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-08T21:34:42.826 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36789.asok 2024-03-08T21:34:42.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:42.826 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36789.asok status 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "7d63482aa89628d733e298984a762389b625c761", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.0.0-1965-g7d63482a (7d63482aa89628d733e298984a762389b625c761) squid (dev)", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "36789", 2024-03-08T21:34:42.994 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4811, 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4811 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-03-08T21:34:42.995 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2717543619 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2717543619 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4811 172.21.15.119:0/2717543619", 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/2717543619", 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2024-03-08T21:34:42.996 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 17, 2024-03-08T21:34:42.997 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 30, 2024-03-08T21:34:42.997 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2024-03-08T21:34:42.997 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2024-03-08T21:34:42.997 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2024-03-08T21:34:42.997 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:43.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:43.009 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2024-03-08T21:34:43.009 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:43.018 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2024-03-08T21:34:43.018 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:43.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:43.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:43.078 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-03-08T21:34:43.127 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.uXpYvP6Ben 2024-03-08T21:34:43.127 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:43.127 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/tmp/tmp.uXpYvP6Ben 2024-03-08T21:34:43.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:43.183 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'mkdir -p dir1/dir2/dir3') 2024-03-08T21:34:43.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:43.305 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'chmod 755 /tmp/test-cephfsuv9endif') 2024-03-08T21:34:43.316 INFO:tasks.cephfs.test_cephfs_shell:Running script "/tmp/test-cephfsuv9endif" 2024-03-08T21:34:43.317 DEBUG:teuthology.orchestra.run.smithi119:> cephfs-shell -b /tmp/test-cephfsuv9endif 2024-03-08T21:34:43.628 INFO:teuthology.orchestra.run.smithi119.stderr:Unrecognized command 2024-03-08T21:34:43.669 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-03-08T21:34:43.669 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-08T21:34:43.669 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T21:34:43.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T21:34:43.811 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-08T21:34:43.811 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:43.811 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T21:34:43.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:43.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 Processor -- start 2024-03-08T21:34:43.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 -- start start 2024-03-08T21:34:43.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f33c413f2b0 0x7f33c4150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:43.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40b2be0 con 0x7f33c40b4410 2024-03-08T21:34:43.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40b5fb0 con 0x7f33c40b47f0 2024-03-08T21:34:43.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33cbc00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c40b5970 con 0x7f33c413f2b0 2024-03-08T21:34:43.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f33c40b4410 0x7f33c40b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34402/0 (socket says 172.21.15.119:34402) 2024-03-08T21:34:43.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 -- 172.21.15.119:0/337907193 learned_addr learned my addr 172.21.15.119:0/337907193 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418934517 0 0) 0x7f33c40b2be0 con 0x7f33c40b4410 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a8003530 con 0x7f33c40b4410 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9c00640 1 --2- 172.21.15.119:0/337907193 >> v2:172.21.15.160:3300/0 conn(0x7f33c413f2b0 0x7f33c4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520567147 0 0) 0x7f33a8003530 con 0x7f33c40b4410 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 >> v2:172.21.15.160:3300/0 conn(0x7f33c413f2b0 msgr2=0x7f33c4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 --2- 172.21.15.119:0/337907193 >> v2:172.21.15.160:3300/0 conn(0x7f33c413f2b0 0x7f33c4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 >> v1:172.21.15.160:6789/0 conn(0x7f33c40b47f0 legacy=0x7f33c413eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40b5600 con 0x7f33c40b4410 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f33b4001680 con 0x7f33c40b4410 2024-03-08T21:34:44.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 >> v1:172.21.15.119:6789/0 conn(0x7f33c40b4410 legacy=0x7f33c40b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a8004810 0x7f33a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33a80051d0 0x7f33a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40b5970 con 0x7f33a80039c0 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a800c100 con 0x7f33a8004810 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a800c300 con 0x7f33a80051d0 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33bbe00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a8004810 0x7f33a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9c00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33a80051d0 0x7f33a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 -- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33a80051d0 msgr2=0x7f33a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33a80051d0 0x7f33a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 -- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a8004810 msgr2=0x7f33a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33a8004810 0x7f33a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9200640 1 -- 172.21.15.119:0/337907193 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8003530 con 0x7f33a80039c0 2024-03-08T21:34:44.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.008+0000 7f33c9c00640 1 -- 172.21.15.119:0/337907193 reap_dead start 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33c9200640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33a8003dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c210 tx=0x7f33b401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d133c41ff6567854 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4007d20 con 0x7f33a80039c0 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40a9020 con 0x7f33a80039c0 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33c3e00640 1 -- 172.21.15.119:0/337907193 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4005ae0 con 0x7f33a80039c0 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 -- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 msgr2=0x7f33a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33a8003dc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c210 tx=0x7f33b401cbc0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 -- 172.21.15.119:0/337907193 shutdown_connections 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 --2- 172.21.15.119:0/337907193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33a8003dc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 -- 172.21.15.119:0/337907193 >> 172.21.15.119:0/337907193 conn(0x7f33c406b6e0 msgr2=0x7f33c40ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 -- 172.21.15.119:0/337907193 shutdown_connections 2024-03-08T21:34:44.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.012+0000 7f33cbc00640 1 -- 172.21.15.119:0/337907193 wait complete. 2024-03-08T21:34:44.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 Processor -- start 2024-03-08T21:34:44.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- start start 2024-03-08T21:34:44.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33c41dfcc0 0x7f33c41387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33c41e0140 0x7f33c4138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4148320 con 0x7f33a80039c0 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c41484a0 con 0x7f33c41e0140 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4148620 con 0x7f33c41dfcc0 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41244/0 (socket says 172.21.15.119:41244) 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 -- 172.21.15.119:0/3518300589 learned_addr learned my addr 172.21.15.119:0/3518300589 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33bbe00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33c41dfcc0 0x7f33c41387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9c00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33c41e0140 0x7f33c4138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 -- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33c41dfcc0 msgr2=0x7f33c41387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33c41dfcc0 0x7f33c41387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 -- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33c41e0140 msgr2=0x7f33c4138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33c41e0140 0x7f33c4138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 -- 172.21.15.119:0/3518300589 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4139220 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c9200640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33b40983c0 tx=0x7f33a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40049f0 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4004b90 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40070d0 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c413ff30 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c413ced0 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.016+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c4067db0 con 0x7f33a80039c0 2024-03-08T21:34:44.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.020+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f33b40bd060 con 0x7f33a80039c0 2024-03-08T21:34:44.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.020+0000 7f33c1600640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 0x7f33a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.020+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33b411e510 con 0x7f33a80039c0 2024-03-08T21:34:44.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.020+0000 7f33bbe00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 0x7f33a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.020+0000 7f33bbe00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 0x7f33a0069b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33c41460f0 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.024+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f33b40168d0 con 0x7f33a80039c0 2024-03-08T21:34:44.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.180+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33c413fc50 con 0x7f33a80039c0 2024-03-08T21:34:44.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.180+0000 7f33c1600640 1 -- 172.21.15.119:0/3518300589 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f33b40ef180 con 0x7f33a80039c0 2024-03-08T21:34:44.171 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:44.172 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:32.540475+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:44.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 msgr2=0x7f33a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 0x7f33a0069b20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33c41460f0 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 msgr2=0x7f33c41479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f33b40983c0 tx=0x7f33a8005840 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 shutdown_connections 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f33a0067660 0x7f33a0069b20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33c41e0140 0x7f33c4138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f33c41dfcc0 0x7f33c41387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 --2- 172.21.15.119:0/3518300589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a80039c0 0x7f33c41479d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 >> 172.21.15.119:0/3518300589 conn(0x7f33c406b6e0 msgr2=0x7f33c40b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 shutdown_connections 2024-03-08T21:34:44.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.184+0000 7f33cbc00640 1 -- 172.21.15.119:0/3518300589 wait complete. 2024-03-08T21:34:44.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:34:28.565574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:34:29.908148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:44.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:44.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 Processor -- start 2024-03-08T21:34:44.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 -- start start 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef3c13e540 0x7fef3c13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13eef0 0x7fef3c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0b6d80 con 0x7fef3c0b4340 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0b56a0 con 0x7fef3c13e540 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef42200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b2980 con 0x7fef3c13eef0 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef3c13e540 0x7fef3c13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef3c13e540 0x7fef3c13e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41248/0 (socket says 172.21.15.119:41248) 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 -- 172.21.15.119:0/1372491086 learned_addr learned my addr 172.21.15.119:0/1372491086 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef40e00640 1 --1- 172.21.15.119:0/1372491086 >> v1:172.21.15.119:6789/0 conn(0x7fef3c0b4340 0x7fef3c0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34418/0 (socket says 172.21.15.119:34418) 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef41800640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13eef0 0x7fef3c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 -- 172.21.15.119:0/1372491086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13eef0 msgr2=0x7fef3c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13eef0 0x7fef3c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 -- 172.21.15.119:0/1372491086 >> v1:172.21.15.119:6789/0 conn(0x7fef3c0b4340 legacy=0x7fef3c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef3be00640 1 -- 172.21.15.119:0/1372491086 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819804040 0 0) 0x7fef3c0b6d80 con 0x7fef3c0b4340 2024-03-08T21:34:44.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.340+0000 7fef33e00640 1 -- 172.21.15.119:0/1372491086 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0b4720 con 0x7fef3c13e540 2024-03-08T21:34:44.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef33e00640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13e540 0x7fef3c13e9b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bdb2afe349164d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef3be00640 1 -- 172.21.15.119:0/1372491086 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240b5070 con 0x7fef3c13e540 2024-03-08T21:34:44.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef3be00640 1 -- 172.21.15.119:0/1372491086 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240a8a50 con 0x7fef3c13e540 2024-03-08T21:34:44.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef3be00640 1 -- 172.21.15.119:0/1372491086 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240a8e20 con 0x7fef3c13e540 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 -- 172.21.15.119:0/1372491086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13e540 msgr2=0x7fef3c13e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13e540 0x7fef3c13e9b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2401ed50 comp rx=0 tx=0).stop 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 -- 172.21.15.119:0/1372491086 shutdown_connections 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13eef0 0x7fef3c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 --2- 172.21.15.119:0/1372491086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13e540 0x7fef3c13e9b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 -- 172.21.15.119:0/1372491086 >> 172.21.15.119:0/1372491086 conn(0x7fef3c06b570 msgr2=0x7fef3c0ba450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 -- 172.21.15.119:0/1372491086 shutdown_connections 2024-03-08T21:34:44.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.344+0000 7fef42200640 1 -- 172.21.15.119:0/1372491086 wait complete. 2024-03-08T21:34:44.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 Processor -- start 2024-03-08T21:34:44.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- start start 2024-03-08T21:34:44.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 0x7fef3c147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 0x7fef3c1dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b5330 con 0x7fef3c13eef0 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b6aa0 con 0x7fef3c0b4340 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c13f320 con 0x7fef3c13e540 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41258/0 (socket says 172.21.15.119:41258) 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 -- 172.21.15.119:0/3154255017 learned_addr learned my addr 172.21.15.119:0/3154255017 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef40e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 0x7fef3c147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef33e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 0x7fef3c1dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 -- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 msgr2=0x7fef3c1dcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 0x7fef3c1dcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 -- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 msgr2=0x7fef3c147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 0x7fef3c147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 -- 172.21.15.119:0/3154255017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c1404b0 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef33e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 0x7fef3c1dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef40e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 0x7fef3c147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef41800640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef3400efc0 tx=0x7fef3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34018020 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34014480 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34014870 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c148c20 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c06dae0 con 0x7fef3c13eef0 2024-03-08T21:34:44.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.348+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3c067db0 con 0x7fef3c13eef0 2024-03-08T21:34:44.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.352+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fef3401b020 con 0x7fef3c13eef0 2024-03-08T21:34:44.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.352+0000 7fef39600640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 0x7fef18069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.352+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef34086650 con 0x7fef3c13eef0 2024-03-08T21:34:44.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.352+0000 7fef40e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 0x7fef18069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.352+0000 7fef40e00640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 0x7fef18069b20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fef2c007fd0 tx=0x7fef2c007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.356+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fef34022030 con 0x7fef3c13eef0 2024-03-08T21:34:44.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.512+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef3c0b23c0 con 0x7fef3c13eef0 2024-03-08T21:34:44.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.512+0000 7fef39600640 1 -- 172.21.15.119:0/3154255017 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef34010040 con 0x7fef3c13eef0 2024-03-08T21:34:44.503 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 msgr2=0x7fef18069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 0x7fef18069b20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fef2c007fd0 tx=0x7fef2c007c20 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 msgr2=0x7fef3c1dd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fef3400efc0 tx=0x7fef3400c490 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 shutdown_connections 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fef18067660 0x7fef18069b20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef3c13eef0 0x7fef3c1dd290 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef3c13e540 0x7fef3c1dcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 --2- 172.21.15.119:0/3154255017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3c0b4340 0x7fef3c147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 >> 172.21.15.119:0/3154255017 conn(0x7fef3c06b570 msgr2=0x7fef3c0b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 shutdown_connections 2024-03-08T21:34:44.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.516+0000 7fef42200640 1 -- 172.21.15.119:0/3154255017 wait complete. 2024-03-08T21:34:44.523 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:44.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 Processor -- start 2024-03-08T21:34:44.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 -- start start 2024-03-08T21:34:44.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 0x7fb3cc0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 0x7fb3cc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0b39c0 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0b7e60 con 0x7fb3cc06c5e0 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d3400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0b3ca0 con 0x7fb3cc0b4420 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41274/0 (socket says 172.21.15.119:41274) 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 -- 172.21.15.119:0/1455636735 learned_addr learned my addr 172.21.15.119:0/1455636735 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d1400640 1 --2- 172.21.15.119:0/1455636735 >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 0x7fb3cc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d0a00640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 0x7fb3cc0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 -- 172.21.15.119:0/1455636735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 msgr2=0x7fb3cc0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 0x7fb3cc0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 -- 172.21.15.119:0/1455636735 >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 msgr2=0x7fb3cc06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/1455636735 >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 0x7fb3cc06ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3c3e00640 1 -- 172.21.15.119:0/1455636735 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc06d890 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d1400640 1 --2- 172.21.15.119:0/1455636735 >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 0x7fb3cc06ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:44.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.672+0000 7fb3d0a00640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 0x7fb3cc0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:44.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc072a00 tx=0x7fb3b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb34d1fb64ecd17 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3cbe00640 1 -- 172.21.15.119:0/1455636735 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40b0070 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3cbe00640 1 -- 172.21.15.119:0/1455636735 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40ab600 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3cbe00640 1 -- 172.21.15.119:0/1455636735 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40ab9d0 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- 172.21.15.119:0/1455636735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b74c0 msgr2=0x7fb3cc0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc072a00 tx=0x7fb3b401c460 comp rx=0 tx=0).stop 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- 172.21.15.119:0/1455636735 shutdown_connections 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 --2- 172.21.15.119:0/1455636735 >> v2:172.21.15.160:3300/0 conn(0x7fb3cc06c5e0 0x7fb3cc06ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc0b7920 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 --2- 172.21.15.119:0/1455636735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc0b4420 0x7fb3cc0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- 172.21.15.119:0/1455636735 >> 172.21.15.119:0/1455636735 conn(0x7fb3cc09a230 msgr2=0x7fb3cc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- 172.21.15.119:0/1455636735 shutdown_connections 2024-03-08T21:34:44.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- 172.21.15.119:0/1455636735 wait complete. 2024-03-08T21:34:44.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 Processor -- start 2024-03-08T21:34:44.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.676+0000 7fb3d3400640 1 -- start start 2024-03-08T21:34:44.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc06c5e0 0x7fb3cc144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc153870 con 0x7fb3cc0b4420 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1536f0 con 0x7fb3cc0b74c0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1539f0 con 0x7fb3cc06c5e0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41282/0 (socket says 172.21.15.119:41282) 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 -- 172.21.15.119:0/565894052 learned_addr learned my addr 172.21.15.119:0/565894052 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d0a00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc06c5e0 0x7fb3cc144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d1400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 -- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc06c5e0 msgr2=0x7fb3cc144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc06c5e0 0x7fb3cc144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 -- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3cc0b74c0 msgr2=0x7fb3cc13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc13efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 -- 172.21.15.119:0/565894052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc14ed30 con 0x7fb3cc0b4420 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c3e00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb3b401ab10 tx=0x7fb3b4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40b0040 con 0x7fb3cc0b4420 2024-03-08T21:34:44.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40b9070 con 0x7fb3cc0b4420 2024-03-08T21:34:44.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40aa920 con 0x7fb3cc0b4420 2024-03-08T21:34:44.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc098d20 con 0x7fb3cc0b4420 2024-03-08T21:34:44.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc0992e0 con 0x7fb3cc0b4420 2024-03-08T21:34:44.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc067db0 con 0x7fb3cc0b4420 2024-03-08T21:34:44.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.680+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb3b40aaac0 con 0x7fb3cc0b4420 2024-03-08T21:34:44.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.684+0000 7fb3c9600640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 0x7fb3a8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.684+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3b411f6f0 con 0x7fb3cc0b4420 2024-03-08T21:34:44.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.684+0000 7fb3d0a00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 0x7fb3a8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.684+0000 7fb3d0a00640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 0x7fb3a8069b20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006fd0 tx=0x7fb3bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.688+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb3b4016110 con 0x7fb3cc0b4420 2024-03-08T21:34:44.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3cc09c260 con 0x7fb3cc0b4420 2024-03-08T21:34:44.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3c9600640 1 -- 172.21.15.119:0/565894052 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3b40f0520 con 0x7fb3cc0b4420 2024-03-08T21:34:44.829 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 msgr2=0x7fb3a8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 0x7fb3a8069b20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006fd0 tx=0x7fb3bc008040 comp rx=0 tx=0).stop 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 msgr2=0x7fb3cc1e2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb3b401ab10 tx=0x7fb3b4019200 comp rx=0 tx=0).stop 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 shutdown_connections 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3a8067660 0x7fb3a8069b20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3cc0b74c0 0x7fb3cc13efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3cc0b4420 0x7fb3cc1e2f60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 --2- 172.21.15.119:0/565894052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3cc06c5e0 0x7fb3cc144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 >> 172.21.15.119:0/565894052 conn(0x7fb3cc09a230 msgr2=0x7fb3cc09ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 shutdown_connections 2024-03-08T21:34:44.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.840+0000 7fb3d3400640 1 -- 172.21.15.119:0/565894052 wait complete. 2024-03-08T21:34:44.850 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:44.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 Processor -- start 2024-03-08T21:34:44.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 -- start start 2024-03-08T21:34:44.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f834c06c840 0x7f834c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c144490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 0x7f834c1413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c1449d0 con 0x7f834c06c840 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c06cc20 con 0x7f834c140fb0 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8353800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0b3670 con 0x7f834c144030 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8350e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f834c06c840 0x7f834c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8350e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f834c06c840 0x7f834c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41288/0 (socket says 172.21.15.119:41288) 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8350e00640 1 -- 172.21.15.119:0/2415778561 learned_addr learned my addr 172.21.15.119:0/2415778561 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f834be00640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8351800640 1 --2- 172.21.15.119:0/2415778561 >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 0x7f834c1413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8350e00640 1 -- 172.21.15.119:0/2415778561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 msgr2=0x7f834c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:44.996+0000 7f8350e00640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8350e00640 1 -- 172.21.15.119:0/2415778561 >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 msgr2=0x7f834c1413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8350e00640 1 --2- 172.21.15.119:0/2415778561 >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 0x7f834c1413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8350e00640 1 -- 172.21.15.119:0/2415778561 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0b3950 con 0x7f834c06c840 2024-03-08T21:34:44.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8351800640 1 --2- 172.21.15.119:0/2415778561 >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 0x7f834c1413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:44.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8350e00640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c06c840 0x7f834c0b3090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f834c09d690 tx=0x7f833c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab0594b94ac2169 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f834b400640 1 -- 172.21.15.119:0/2415778561 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0a5600 con 0x7f834c06c840 2024-03-08T21:34:44.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f834b400640 1 -- 172.21.15.119:0/2415778561 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c0a57a0 con 0x7f834c06c840 2024-03-08T21:34:44.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f834b400640 1 -- 172.21.15.119:0/2415778561 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0a5b70 con 0x7f834c06c840 2024-03-08T21:34:44.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 -- 172.21.15.119:0/2415778561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c06c840 msgr2=0x7f834c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c06c840 0x7f834c0b3090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f834c09d690 tx=0x7f833c01c960 comp rx=0 tx=0).stop 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 -- 172.21.15.119:0/2415778561 shutdown_connections 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 --2- 172.21.15.119:0/2415778561 >> v2:172.21.15.160:3300/0 conn(0x7f834c140fb0 0x7f834c1413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 --2- 172.21.15.119:0/2415778561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c06c840 0x7f834c0b3090 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 -- 172.21.15.119:0/2415778561 >> 172.21.15.119:0/2415778561 conn(0x7f834c09a230 msgr2=0x7f834c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 -- 172.21.15.119:0/2415778561 shutdown_connections 2024-03-08T21:34:44.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.000+0000 7f8353800640 1 -- 172.21.15.119:0/2415778561 wait complete. 2024-03-08T21:34:44.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 Processor -- start 2024-03-08T21:34:44.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- start start 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f834c06c840 0x7f834c1e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c06e100 con 0x7f834c140fb0 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c06df80 con 0x7f834c06c840 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c147aa0 con 0x7f834c144030 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41298/0 (socket says 172.21.15.119:41298) 2024-03-08T21:34:44.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 -- 172.21.15.119:0/1752009829 learned_addr learned my addr 172.21.15.119:0/1752009829 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8350e00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f834c06c840 0x7f834c1e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8351800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 -- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 msgr2=0x7f834c099820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c099820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 -- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f834c06c840 msgr2=0x7f834c1e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f834c06c840 0x7f834c1e0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 -- 172.21.15.119:0/1752009829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0aeb10 con 0x7f834c140fb0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f834be00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f833800e870 tx=0x7f833800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338017070 con 0x7f834c140fb0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800c940 con 0x7f834c140fb0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c0686e0 con 0x7f834c140fb0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800cd10 con 0x7f834c140fb0 2024-03-08T21:34:44.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.004+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c071310 con 0x7f834c140fb0 2024-03-08T21:34:44.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c071510 con 0x7f834c140fb0 2024-03-08T21:34:44.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f833801a070 con 0x7f834c140fb0 2024-03-08T21:34:44.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8348c00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 0x7f832c069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83380859d0 con 0x7f834c140fb0 2024-03-08T21:34:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8350e00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 0x7f832c069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:44.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.008+0000 7f8350e00640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 0x7f832c069b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f833c0ae000 tx=0x7f833c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.012+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f834c071510 con 0x7f834c140fb0 2024-03-08T21:34:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f834c067db0 con 0x7f834c140fb0 2024-03-08T21:34:45.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8348c00640 1 -- 172.21.15.119:0/1752009829 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8338055ff0 con 0x7f834c140fb0 2024-03-08T21:34:45.159 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 msgr2=0x7f832c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 0x7f832c069b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f833c0ae000 tx=0x7f833c0a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 msgr2=0x7f834c0992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f833800e870 tx=0x7f833800ed30 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 shutdown_connections 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f832c067690 0x7f832c069b50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f834c144030 0x7f834c099820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f834c140fb0 0x7f834c0992e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 --2- 172.21.15.119:0/1752009829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f834c06c840 0x7f834c1e0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 >> 172.21.15.119:0/1752009829 conn(0x7f834c09a230 msgr2=0x7f834c09a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 shutdown_connections 2024-03-08T21:34:45.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.168+0000 7f8353800640 1 -- 172.21.15.119:0/1752009829 wait complete. 2024-03-08T21:34:45.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T21:34:45.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 Processor -- start 2024-03-08T21:34:45.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 -- start start 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6468147740 0x7f646813d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6468067110 con 0x7f6468070980 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6468071d70 con 0x7f6468066d30 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f646ce00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6468071a90 con 0x7f6468147740 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6468147740 0x7f646813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6468147740 0x7f646813d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41306/0 (socket says 172.21.15.119:41306) 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 -- 172.21.15.119:0/3946708859 learned_addr learned my addr 172.21.15.119:0/3946708859 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:45.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6466a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6468070980 0x7f646813d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34428/0 (socket says 172.21.15.119:34428) 2024-03-08T21:34:45.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 -- 172.21.15.119:0/3946708859 >> v1:172.21.15.160:6789/0 conn(0x7f6468066d30 legacy=0x7f6468147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:45.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 -- 172.21.15.119:0/3946708859 >> v1:172.21.15.119:6789/0 conn(0x7f6468070980 legacy=0x7f646813d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.324+0000 7f6467e00640 1 -- 172.21.15.119:0/3946708859 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468072570 con 0x7f6468147740 2024-03-08T21:34:45.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f6467e00640 1 --2- 172.21.15.119:0/3946708859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468147740 0x7f646813d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8937338e69592afc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f6466000640 1 -- 172.21.15.119:0/3946708859 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600b0070 con 0x7f6468147740 2024-03-08T21:34:45.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f6466000640 1 -- 172.21.15.119:0/3946708859 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64600ab600 con 0x7f6468147740 2024-03-08T21:34:45.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f6466000640 1 -- 172.21.15.119:0/3946708859 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600ab9d0 con 0x7f6468147740 2024-03-08T21:34:45.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 -- 172.21.15.119:0/3946708859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468147740 msgr2=0x7f646813d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 --2- 172.21.15.119:0/3946708859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468147740 0x7f646813d740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646001c490 comp rx=0 tx=0).stop 2024-03-08T21:34:45.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 -- 172.21.15.119:0/3946708859 shutdown_connections 2024-03-08T21:34:45.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 --2- 172.21.15.119:0/3946708859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468147740 0x7f646813d740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 -- 172.21.15.119:0/3946708859 >> 172.21.15.119:0/3946708859 conn(0x7f646806ad50 msgr2=0x7f646806b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:45.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 -- 172.21.15.119:0/3946708859 shutdown_connections 2024-03-08T21:34:45.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 -- 172.21.15.119:0/3946708859 wait complete. 2024-03-08T21:34:45.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.328+0000 7f646ce00640 1 Processor -- start 2024-03-08T21:34:45.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- start start 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6468070980 0x7f646813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6468147740 0x7f646813ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468155120 con 0x7f6468066d30 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468154fa0 con 0x7f6468147740 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64681552a0 con 0x7f6468070980 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41320/0 (socket says 172.21.15.119:41320) 2024-03-08T21:34:45.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 -- 172.21.15.119:0/3609076332 learned_addr learned my addr 172.21.15.119:0/3609076332 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6466a00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6468070980 0x7f646813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467e00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6468147740 0x7f646813ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 -- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6468070980 msgr2=0x7f646813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6468070980 0x7f646813e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 -- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6468147740 msgr2=0x7f646813ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6468147740 0x7f646813ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 -- 172.21.15.119:0/3609076332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64681dfd20 con 0x7f6468066d30 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f6467400640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f645800c7f0 tx=0x7f645800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458016020 con 0x7f6468066d30 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645800aa50 con 0x7f6468066d30 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64681e0000 con 0x7f6468066d30 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645800ae40 con 0x7f6468066d30 2024-03-08T21:34:45.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6468144710 con 0x7f6468066d30 2024-03-08T21:34:45.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.332+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64680750f0 con 0x7f6468066d30 2024-03-08T21:34:45.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.336+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6458019020 con 0x7f6468066d30 2024-03-08T21:34:45.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.336+0000 7f645f400640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 0x7f6448069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.336+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6458085760 con 0x7f6468066d30 2024-03-08T21:34:45.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.336+0000 7f6466a00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 0x7f6448069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.336+0000 7f6466a00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 0x7f6448069b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f646813df20 tx=0x7f6454007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.340+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f6458020030 con 0x7f6468066d30 2024-03-08T21:34:45.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.504+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f64680714d0 con 0x7f6468066d30 2024-03-08T21:34:45.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.504+0000 7f645f400640 1 -- 172.21.15.119:0/3609076332 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6458055e20 con 0x7f6468066d30 2024-03-08T21:34:45.495 INFO:teuthology.orchestra.run.smithi119.stderr:listed 0 entries 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 msgr2=0x7f6448069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 0x7f6448069b20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f646813df20 tx=0x7f6454007e90 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 msgr2=0x7f64680aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f645800c7f0 tx=0x7f645800ccb0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 shutdown_connections 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6448067660 0x7f6448069b20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6468147740 0x7f646813ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6468070980 0x7f646813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 --2- 172.21.15.119:0/3609076332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6468066d30 0x7f64680aea50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 >> 172.21.15.119:0/3609076332 conn(0x7f646806ad50 msgr2=0x7f6468144b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:45.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 shutdown_connections 2024-03-08T21:34:45.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.508+0000 7f646ce00640 1 -- 172.21.15.119:0/3609076332 wait complete. 2024-03-08T21:34:45.515 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2024-03-08T21:34:45.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:45.516 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-08T21:34:45.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[36789]: fuse finished with error 0 and tester_r 0 2024-03-08T21:34:45.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:34:45.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:45.536 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-08T21:34:45.671 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:45.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 Processor -- start 2024-03-08T21:34:45.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 -- start start 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41940b8710 0x7f41941479c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f419414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4194147200 con 0x7f419414afb0 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419414b4d0 con 0x7f41940b8710 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f419a600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194147530 con 0x7f419406e720 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41940b8710 0x7f41941479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41940b8710 0x7f41941479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41332/0 (socket says 172.21.15.119:41332) 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 -- 172.21.15.119:0/1211286809 learned_addr learned my addr 172.21.15.119:0/1211286809 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f418aa00640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f419414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 -- 172.21.15.119:0/1211286809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 msgr2=0x7f419414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f419414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 -- 172.21.15.119:0/1211286809 >> v1:172.21.15.119:6789/0 conn(0x7f419414afb0 legacy=0x7f4194144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4193400640 1 -- 172.21.15.119:0/1211286809 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940b8af0 con 0x7f41940b8710 2024-03-08T21:34:45.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.816+0000 7f4192a00640 1 -- 172.21.15.119:0/1211286809 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793183730 0 0) 0x7f4194147200 con 0x7f419414afb0 2024-03-08T21:34:45.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f4193400640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f41941479c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4184009870 tx=0x7f418401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb930aef5420 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f4192a00640 1 -- 172.21.15.119:0/1211286809 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840aa5f0 con 0x7f41940b8710 2024-03-08T21:34:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f4192a00640 1 -- 172.21.15.119:0/1211286809 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840af070 con 0x7f41940b8710 2024-03-08T21:34:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f4192a00640 1 -- 172.21.15.119:0/1211286809 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840aa9b0 con 0x7f41940b8710 2024-03-08T21:34:45.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 -- 172.21.15.119:0/1211286809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 msgr2=0x7f41941479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f41941479c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4184009870 tx=0x7f418401c4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 -- 172.21.15.119:0/1211286809 shutdown_connections 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f419414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 --2- 172.21.15.119:0/1211286809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f41941479c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 -- 172.21.15.119:0/1211286809 >> 172.21.15.119:0/1211286809 conn(0x7f419409c460 msgr2=0x7f419409c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 -- 172.21.15.119:0/1211286809 shutdown_connections 2024-03-08T21:34:45.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.820+0000 7f419a600640 1 -- 172.21.15.119:0/1211286809 wait complete. 2024-03-08T21:34:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 Processor -- start 2024-03-08T21:34:45.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- start start 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f41941e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f419414afb0 0x7f41941df930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194154440 con 0x7f41940b8710 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941542c0 con 0x7f419414afb0 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41941545c0 con 0x7f419406e720 2024-03-08T21:34:45.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41348/0 (socket says 172.21.15.119:41348) 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 -- 172.21.15.119:0/3754077271 learned_addr learned my addr 172.21.15.119:0/3754077271 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f4193400640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f41941e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f4193e00640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f419414afb0 0x7f41941df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 -- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 msgr2=0x7f41941e3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f41941e3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 -- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f419414afb0 msgr2=0x7f41941df930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f419414afb0 0x7f41941df930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 -- 172.21.15.119:0/3754077271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940afdc0 con 0x7f41940b8710 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418aa00640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d7d0 tx=0x7f417c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00b6c0 con 0x7f41940b8710 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c019070 con 0x7f41940b8710 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00baa0 con 0x7f41940b8710 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41941e2f40 con 0x7f41940b8710 2024-03-08T21:34:45.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41941e3500 con 0x7f41940b8710 2024-03-08T21:34:45.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.824+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41940b1880 con 0x7f41940b8710 2024-03-08T21:34:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.828+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f417c00bc40 con 0x7f41940b8710 2024-03-08T21:34:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.828+0000 7f418be00640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 0x7f4170069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.828+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f417c085b00 con 0x7f41940b8710 2024-03-08T21:34:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.828+0000 7f4193400640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 0x7f4170069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:45.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.828+0000 7f4193400640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 0x7f4170069b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f41840ae000 tx=0x7f41840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:45.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:45.832+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f417c0561c0 con 0x7f41940b8710 2024-03-08T21:34:46.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.016+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4194067db0 con 0x7f41940b8710 2024-03-08T21:34:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.016+0000 7f418be00640 1 -- 172.21.15.119:0/3754077271 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7f417c05a260 con 0x7f41940b8710 2024-03-08T21:34:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:46.007 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:46.007 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 msgr2=0x7f4170069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 0x7f4170069b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f41840ae000 tx=0x7f41840a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 msgr2=0x7f4194141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d7d0 tx=0x7f417c00dc90 comp rx=0 tx=0).stop 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 shutdown_connections 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f4170067690 0x7f4170069b50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f419414afb0 0x7f41941df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41940b8710 0x7f4194141210 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 --2- 172.21.15.119:0/3754077271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f419406e720 0x7f41941e3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 >> 172.21.15.119:0/3754077271 conn(0x7f419409c460 msgr2=0x7f4194142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 shutdown_connections 2024-03-08T21:34:46.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.020+0000 7f419a600640 1 -- 172.21.15.119:0/3754077271 wait complete. 2024-03-08T21:34:46.028 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:46.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 Processor -- start 2024-03-08T21:34:46.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 -- start start 2024-03-08T21:34:46.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c09a080 con 0x7f6a5c0b1d30 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5c0b4510 con 0x7f6a5c099ca0 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a60c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5c0b4b60 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41364/0 (socket says 172.21.15.119:41364) 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 -- 172.21.15.119:0/2138561182 learned_addr learned my addr 172.21.15.119:0/2138561182 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a5a800640 1 --1- 172.21.15.119:0/2138561182 >> v1:172.21.15.119:6789/0 conn(0x7f6a5c0b1d30 0x7f6a5c0b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34454/0 (socket says 172.21.15.119:34454) 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 -- 172.21.15.119:0/2138561182 >> v1:172.21.15.160:6789/0 conn(0x7f6a5c099ca0 legacy=0x7f6a5c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:46.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 -- 172.21.15.119:0/2138561182 >> v1:172.21.15.119:6789/0 conn(0x7f6a5c0b1d30 legacy=0x7f6a5c0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.172+0000 7f6a51400640 1 -- 172.21.15.119:0/2138561182 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c0b47f0 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a51400640 1 --2- 172.21.15.119:0/2138561182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eb01c941dab509 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a59400640 1 -- 172.21.15.119:0/2138561182 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440ab430 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a59400640 1 -- 172.21.15.119:0/2138561182 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440b0070 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a59400640 1 -- 172.21.15.119:0/2138561182 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440ab7f0 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 -- 172.21.15.119:0/2138561182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c09a8d0 msgr2=0x7f6a5c09ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2138561182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009870 tx=0x7f6a4401c520 comp rx=0 tx=0).stop 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 -- 172.21.15.119:0/2138561182 shutdown_connections 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2138561182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c09a8d0 0x7f6a5c09ad40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 -- 172.21.15.119:0/2138561182 >> 172.21.15.119:0/2138561182 conn(0x7f6a5c06c620 msgr2=0x7f6a5c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 -- 172.21.15.119:0/2138561182 shutdown_connections 2024-03-08T21:34:46.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.176+0000 7f6a60c00640 1 -- 172.21.15.119:0/2138561182 wait complete. 2024-03-08T21:34:46.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 Processor -- start 2024-03-08T21:34:46.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- start start 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c09a8d0 0x7f6a5c1e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c0b1d30 0x7f6a5c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c1532e0 con 0x7f6a5c099ca0 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c153160 con 0x7f6a5c0b1d30 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5c153460 con 0x7f6a5c09a8d0 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41374/0 (socket says 172.21.15.119:41374) 2024-03-08T21:34:46.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 -- 172.21.15.119:0/2964443513 learned_addr learned my addr 172.21.15.119:0/2964443513 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a51400640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c09a8d0 0x7f6a5c1e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a5a800640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c0b1d30 0x7f6a5c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 -- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c09a8d0 msgr2=0x7f6a5c1e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c09a8d0 0x7f6a5c1e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 -- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c0b1d30 msgr2=0x7f6a5c13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c0b1d30 0x7f6a5c13af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 -- 172.21.15.119:0/2964443513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c13b890 con 0x7f6a5c099ca0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a59e00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00ba80 tx=0x7f6a4c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c019070 con 0x7f6a5c099ca0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00cc90 con 0x7f6a5c099ca0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c014680 con 0x7f6a5c099ca0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5c1e36b0 con 0x7f6a5c099ca0 2024-03-08T21:34:46.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5c1e43f0 con 0x7f6a5c099ca0 2024-03-08T21:34:46.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.180+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5c067db0 con 0x7f6a5c099ca0 2024-03-08T21:34:46.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.184+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f6a4c01c070 con 0x7f6a5c099ca0 2024-03-08T21:34:46.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.184+0000 7f6a52a00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 0x7f6a38069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.184+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a4c085650 con 0x7f6a5c099ca0 2024-03-08T21:34:46.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.184+0000 7f6a51400640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 0x7f6a38069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.184+0000 7f6a51400640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 0x7f6a38069b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a440af000 tx=0x7f6a440a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.188+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f6a4c056360 con 0x7f6a5c099ca0 2024-03-08T21:34:46.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.340+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5c139420 con 0x7f6a5c099ca0 2024-03-08T21:34:46.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.340+0000 7f6a52a00640 1 -- 172.21.15.119:0/2964443513 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f6a4c055c60 con 0x7f6a5c099ca0 2024-03-08T21:34:46.331 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:46.331 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:32.540475+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 msgr2=0x7f6a38069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 0x7f6a38069b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a440af000 tx=0x7f6a440a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 msgr2=0x7f6a5c13dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00ba80 tx=0x7f6a4c00bf40 comp rx=0 tx=0).stop 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 shutdown_connections 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6a38067660 0x7f6a38069b20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a5c0b1d30 0x7f6a5c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a5c09a8d0 0x7f6a5c1e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 --2- 172.21.15.119:0/2964443513 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c099ca0 0x7f6a5c13dc30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 >> 172.21.15.119:0/2964443513 conn(0x7f6a5c06c620 msgr2=0x7f6a5c143790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 shutdown_connections 2024-03-08T21:34:46.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.344+0000 7f6a60c00640 1 -- 172.21.15.119:0/2964443513 wait complete. 2024-03-08T21:34:46.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T21:33:34.472655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T21:34:28.565574+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T21:34:29.908148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T21:34:46.352 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T21:34:46.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 Processor -- start 2024-03-08T21:34:46.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 -- start start 2024-03-08T21:34:46.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66380b42b0 0x7f663806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 0x7f6638142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66380b4690 0x7f66381483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66381456a0 con 0x7f66380b4690 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380b3850 con 0x7f6638145b30 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f663ca00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663806e0b0 con 0x7f66380b42b0 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66380b4690 0x7f66381483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66380b4690 0x7f66381483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41386/0 (socket says 172.21.15.119:41386) 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 -- 172.21.15.119:0/1069069807 learned_addr learned my addr 172.21.15.119:0/1069069807 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 -- 172.21.15.119:0/1069069807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66380b42b0 msgr2=0x7f663806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 --2- 172.21.15.119:0/1069069807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66380b42b0 0x7f663806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 -- 172.21.15.119:0/1069069807 >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 msgr2=0x7f6638142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f662d400640 1 --2- 172.21.15.119:0/1069069807 >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 0x7f6638142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.500+0000 7f6636800640 1 --2- 172.21.15.119:0/1069069807 >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 0x7f6638142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f6636800640 1 -- 172.21.15.119:0/1069069807 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638145050 con 0x7f66380b4690 2024-03-08T21:34:46.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f662d400640 1 --2- 172.21.15.119:0/1069069807 >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 0x7f6638142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:46.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f6636800640 1 --2- 172.21.15.119:0/1069069807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b4690 0x7f66381483b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f663806ec10 tx=0x7f663001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e851dc8f0de072 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f6635400640 1 -- 172.21.15.119:0/1069069807 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300b0070 con 0x7f66380b4690 2024-03-08T21:34:46.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f6635400640 1 -- 172.21.15.119:0/1069069807 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66300ab600 con 0x7f66380b4690 2024-03-08T21:34:46.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f6635400640 1 -- 172.21.15.119:0/1069069807 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300ab9d0 con 0x7f66380b4690 2024-03-08T21:34:46.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 -- 172.21.15.119:0/1069069807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b4690 msgr2=0x7f66381483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 --2- 172.21.15.119:0/1069069807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b4690 0x7f66381483b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f663806ec10 tx=0x7f663001c490 comp rx=0 tx=0).stop 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 -- 172.21.15.119:0/1069069807 shutdown_connections 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 --2- 172.21.15.119:0/1069069807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b4690 0x7f66381483b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 --2- 172.21.15.119:0/1069069807 >> v2:172.21.15.160:3300/0 conn(0x7f6638145b30 0x7f6638142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 --2- 172.21.15.119:0/1069069807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66380b42b0 0x7f663806c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 -- 172.21.15.119:0/1069069807 >> 172.21.15.119:0/1069069807 conn(0x7f663809a230 msgr2=0x7f663809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 -- 172.21.15.119:0/1069069807 shutdown_connections 2024-03-08T21:34:46.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.504+0000 7f663ca00640 1 -- 172.21.15.119:0/1069069807 wait complete. 2024-03-08T21:34:46.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 Processor -- start 2024-03-08T21:34:46.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- start start 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66380b4690 0x7f6638147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6638145b30 0x7f66381ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638151870 con 0x7f66380b42b0 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381516f0 con 0x7f66380b4690 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66381519f0 con 0x7f6638145b30 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41392/0 (socket says 172.21.15.119:41392) 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 -- 172.21.15.119:0/882967472 learned_addr learned my addr 172.21.15.119:0/882967472 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f662d400640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66380b4690 0x7f6638147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6636800640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6638145b30 0x7f66381ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 -- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6638145b30 msgr2=0x7f66381ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6638145b30 0x7f66381ddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 -- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66380b4690 msgr2=0x7f6638147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66380b4690 0x7f6638147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 -- 172.21.15.119:0/882967472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638146330 con 0x7f66380b42b0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f6635e00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f662800ba50 tx=0x7f662800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628019070 con 0x7f66380b42b0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800cba0 con 0x7f66380b42b0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66380afa90 con 0x7f66380b42b0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628014440 con 0x7f66380b42b0 2024-03-08T21:34:46.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.508+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6638147ca0 con 0x7f66380b42b0 2024-03-08T21:34:46.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380b1db0 con 0x7f66380b42b0 2024-03-08T21:34:46.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f662801c070 con 0x7f66380b42b0 2024-03-08T21:34:46.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f662ea00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 0x7f6614069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6628085590 con 0x7f66380b42b0 2024-03-08T21:34:46.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f662d400640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 0x7f6614069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.512+0000 7f662d400640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 0x7f6614069b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6620006fd0 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.516+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f6628056200 con 0x7f66380b42b0 2024-03-08T21:34:46.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6638067db0 con 0x7f66380b42b0 2024-03-08T21:34:46.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f662ea00640 1 -- 172.21.15.119:0/882967472 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6628055b00 con 0x7f66380b42b0 2024-03-08T21:34:46.669 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 1 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 msgr2=0x7f6614069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 0x7f6614069b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6620006fd0 tx=0x7f6620008040 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 msgr2=0x7f6638146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f662800ba50 tx=0x7f662800bf10 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 shutdown_connections 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6614067660 0x7f6614069b20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6638145b30 0x7f66381ddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66380b4690 0x7f6638147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 --2- 172.21.15.119:0/882967472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66380b42b0 0x7f6638146780 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 >> 172.21.15.119:0/882967472 conn(0x7f663809a230 msgr2=0x7f6638073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.680+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 shutdown_connections 2024-03-08T21:34:46.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.684+0000 7f663ca00640 1 -- 172.21.15.119:0/882967472 wait complete. 2024-03-08T21:34:46.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T21:34:46.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.836+0000 7ff0d7e00640 1 Processor -- start 2024-03-08T21:34:46.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.836+0000 7ff0d7e00640 1 -- start start 2024-03-08T21:34:46.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 0x7ff0d80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0d813f090 0x7ff0d814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d80b2c30 con 0x7ff0d80b6980 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5430 con 0x7ff0d813f090 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80b5950 con 0x7ff0d80b4210 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0d813f090 0x7ff0d814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0ce000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff0d80b6980 0x7ff0d813e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34456/0 (socket says 172.21.15.119:34456) 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0ce000640 1 -- 172.21.15.119:0/4196441776 learned_addr learned my addr 172.21.15.119:0/4196441776 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d6a00640 1 --2- 172.21.15.119:0/4196441776 >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 0x7ff0d80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 -- 172.21.15.119:0/4196441776 >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 msgr2=0x7ff0d80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 --2- 172.21.15.119:0/4196441776 >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 0x7ff0d80b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 -- 172.21.15.119:0/4196441776 >> v1:172.21.15.119:6789/0 conn(0x7ff0d80b6980 legacy=0x7ff0d813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 -- 172.21.15.119:0/4196441776 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80b51c0 con 0x7ff0d813f090 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d6000640 1 -- 172.21.15.119:0/4196441776 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823150312 0 0) 0x7ff0d80b2c30 con 0x7ff0d80b6980 2024-03-08T21:34:46.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d6a00640 1 --2- 172.21.15.119:0/4196441776 >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 0x7ff0d80b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:46.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.840+0000 7ff0d7400640 1 --2- 172.21.15.119:0/4196441776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d814f3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806bce0 tx=0x7ff0d001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b8319fd2a59e65 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d6000640 1 -- 172.21.15.119:0/4196441776 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00a66e0 con 0x7ff0d813f090 2024-03-08T21:34:46.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d6000640 1 -- 172.21.15.119:0/4196441776 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00a6880 con 0x7ff0d813f090 2024-03-08T21:34:46.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d6000640 1 -- 172.21.15.119:0/4196441776 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00a6c50 con 0x7ff0d813f090 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- 172.21.15.119:0/4196441776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 msgr2=0x7ff0d814f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/4196441776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d814f3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff0d806bce0 tx=0x7ff0d001c810 comp rx=0 tx=0).stop 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- 172.21.15.119:0/4196441776 shutdown_connections 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/4196441776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d814f3c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/4196441776 >> v2:172.21.15.160:3300/0 conn(0x7ff0d80b4210 0x7ff0d80b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- 172.21.15.119:0/4196441776 >> 172.21.15.119:0/4196441776 conn(0x7ff0d806b5d0 msgr2=0x7ff0d80b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- 172.21.15.119:0/4196441776 shutdown_connections 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- 172.21.15.119:0/4196441776 wait complete. 2024-03-08T21:34:46.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 Processor -- start 2024-03-08T21:34:46.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- start start 2024-03-08T21:34:46.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d80b4210 0x7ff0d8134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 0x7ff0d806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81524b0 con 0x7ff0d813f090 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8152330 con 0x7ff0d80b4210 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8152630 con 0x7ff0d80b6980 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41414/0 (socket says 172.21.15.119:41414) 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 -- 172.21.15.119:0/2539044828 learned_addr learned my addr 172.21.15.119:0/2539044828 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d6a00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d80b4210 0x7ff0d8134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0ce000640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 0x7ff0d806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 -- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 msgr2=0x7ff0d806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 0x7ff0d806d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 -- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d80b4210 msgr2=0x7ff0d8134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d80b4210 0x7ff0d8134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0d7400640 1 -- 172.21.15.119:0/2539044828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d806ca20 con 0x7ff0d813f090 2024-03-08T21:34:46.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.844+0000 7ff0ce000640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 0x7ff0d806d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:46.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d7400640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b0040 tx=0x7ff0d00195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00be070 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00b8860 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d806dcd0 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b8c50 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d813b890 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8067db0 con 0x7ff0d813f090 2024-03-08T21:34:46.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff0d00c1070 con 0x7ff0d813f090 2024-03-08T21:34:46.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 0x7ff0b4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:46.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0d0120aa0 con 0x7ff0d813f090 2024-03-08T21:34:46.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d6a00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 0x7ff0b4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:46.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.848+0000 7ff0d6a00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 0x7ff0b4069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0d813c080 tx=0x7ff0c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:46.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:46.852+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff0d00c8030 con 0x7ff0d813f090 2024-03-08T21:34:46.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.004+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0d80b9ef0 con 0x7ff0d813f090 2024-03-08T21:34:46.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0cfe00640 1 -- 172.21.15.119:0/2539044828 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0d0016520 con 0x7ff0d813f090 2024-03-08T21:34:46.996 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 32 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 msgr2=0x7ff0b4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 0x7ff0b4069b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0d813c080 tx=0x7ff0c8008040 comp rx=0 tx=0).stop 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 msgr2=0x7ff0d806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00b0040 tx=0x7ff0d00195b0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 shutdown_connections 2024-03-08T21:34:46.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff0b4067660 0x7ff0b4069b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d813f090 0x7ff0d806c0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d80b6980 0x7ff0d806d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 --2- 172.21.15.119:0/2539044828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d80b4210 0x7ff0d8134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 >> 172.21.15.119:0/2539044828 conn(0x7ff0d806b5d0 msgr2=0x7ff0d813e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 shutdown_connections 2024-03-08T21:34:46.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.008+0000 7ff0d7e00640 1 -- 172.21.15.119:0/2539044828 wait complete. 2024-03-08T21:34:47.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T21:34:47.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.164+0000 7f8edac00640 1 Processor -- start 2024-03-08T21:34:47.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.164+0000 7f8edac00640 1 -- start start 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ed40b4210 0x7f8ed40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8ed40b6980 0x7f8ed413e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b3590 0x7f8ed413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed40b2c30 con 0x7f8ed40b4210 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed40b51c0 con 0x7f8ed40b6980 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8edac00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40b5430 con 0x7f8ed40b3590 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ed40b4210 0x7f8ed40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ed40b4210 0x7f8ed40b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41418/0 (socket says 172.21.15.119:41418) 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 -- 172.21.15.119:0/704222825 learned_addr learned my addr 172.21.15.119:0/704222825 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8eda200640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b3590 0x7f8ed413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed8e00640 1 --2- 172.21.15.119:0/704222825 >> v2:172.21.15.160:3300/0 conn(0x7f8ed40b6980 0x7f8ed413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 -- 172.21.15.119:0/704222825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b3590 msgr2=0x7f8ed413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b3590 0x7f8ed413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 -- 172.21.15.119:0/704222825 >> v2:172.21.15.160:3300/0 conn(0x7f8ed40b6980 msgr2=0x7f8ed413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:47.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 --2- 172.21.15.119:0/704222825 >> v2:172.21.15.160:3300/0 conn(0x7f8ed40b6980 0x7f8ed413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.168+0000 7f8ed9800640 1 -- 172.21.15.119:0/704222825 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed40b5950 con 0x7f8ed40b4210 2024-03-08T21:34:47.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed9800640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b4210 0x7f8ed40b3050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4073150 tx=0x7f8ec801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fbd187c5037c63 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed3e00640 1 -- 172.21.15.119:0/704222825 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80b0070 con 0x7f8ed40b4210 2024-03-08T21:34:47.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed3e00640 1 -- 172.21.15.119:0/704222825 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec80ab600 con 0x7f8ed40b4210 2024-03-08T21:34:47.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed3e00640 1 -- 172.21.15.119:0/704222825 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80ab9d0 con 0x7f8ed40b4210 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- 172.21.15.119:0/704222825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b4210 msgr2=0x7f8ed40b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b4210 0x7f8ed40b3050 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4073150 tx=0x7f8ec801c490 comp rx=0 tx=0).stop 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- 172.21.15.119:0/704222825 shutdown_connections 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b3590 0x7f8ed413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- 172.21.15.119:0/704222825 >> v2:172.21.15.160:3300/0 conn(0x7f8ed40b6980 0x7f8ed413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- 172.21.15.119:0/704222825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b4210 0x7f8ed40b3050 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- 172.21.15.119:0/704222825 >> 172.21.15.119:0/704222825 conn(0x7f8ed406b5d0 msgr2=0x7f8ed40b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- 172.21.15.119:0/704222825 shutdown_connections 2024-03-08T21:34:47.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- 172.21.15.119:0/704222825 wait complete. 2024-03-08T21:34:47.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 Processor -- start 2024-03-08T21:34:47.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- start start 2024-03-08T21:34:47.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed40b3590 0x7f8ed40b9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 0x7f8ed4146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4148c10 con 0x7f8ed40b6980 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4148a90 con 0x7f8ed40b3590 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8edac00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4148d90 con 0x7f8ed40b4210 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8eda200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8eda200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41426/0 (socket says 172.21.15.119:41426) 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8eda200640 1 -- 172.21.15.119:0/2864758892 learned_addr learned my addr 172.21.15.119:0/2864758892 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed9800640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed40b3590 0x7f8ed40b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.172+0000 7f8ed8e00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 0x7f8ed4146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 -- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 msgr2=0x7f8ed4146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 0x7f8ed4146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 -- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed40b3590 msgr2=0x7f8ed40b9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed40b3590 0x7f8ed40b9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 -- 172.21.15.119:0/2864758892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4146020 con 0x7f8ed40b6980 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed8e00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 0x7f8ed4146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8eda200640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc007e60 tx=0x7f8ecc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc014620 con 0x7f8ed40b6980 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc019070 con 0x7f8ed40b6980 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc014a00 con 0x7f8ed40b6980 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4146300 con 0x7f8ed40b6980 2024-03-08T21:34:47.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed406d8d0 con 0x7f8ed40b6980 2024-03-08T21:34:47.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed4067db0 con 0x7f8ed40b6980 2024-03-08T21:34:47.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f8ecc014ba0 con 0x7f8ed40b6980 2024-03-08T21:34:47.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.176+0000 7f8ed1600640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 0x7f8eb4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.180+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ecc0860c0 con 0x7f8ed40b6980 2024-03-08T21:34:47.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.180+0000 7f8ed9800640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 0x7f8eb4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.180+0000 7f8ed9800640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 0x7f8eb4069b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80ad000 tx=0x7f8ec80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.184+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f8ecc056d30 con 0x7f8ed40b6980 2024-03-08T21:34:47.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.336+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ed414d460 con 0x7f8ed40b6980 2024-03-08T21:34:47.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.336+0000 7f8ed1600640 1 -- 172.21.15.119:0/2864758892 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ecc056630 con 0x7f8ed40b6980 2024-03-08T21:34:47.326 INFO:teuthology.orchestra.run.smithi119.stdout:pg_num: 64 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 msgr2=0x7f8eb4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 0x7f8eb4069b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80ad000 tx=0x7f8ec80a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 msgr2=0x7f8ed4147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc007e60 tx=0x7f8ecc00e4b0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 shutdown_connections 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8eb4067660 0x7f8eb4069b20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ed40b6980 0x7f8ed4147050 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ed40b4210 0x7f8ed4146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 --2- 172.21.15.119:0/2864758892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed40b3590 0x7f8ed40b9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 >> 172.21.15.119:0/2864758892 conn(0x7f8ed406b5d0 msgr2=0x7f8ed414dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 shutdown_connections 2024-03-08T21:34:47.329 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.340+0000 7f8edac00640 1 -- 172.21.15.119:0/2864758892 wait complete. 2024-03-08T21:34:47.347 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:47.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 Processor -- start 2024-03-08T21:34:47.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 -- start start 2024-03-08T21:34:47.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0b5a60 con 0x7fc09c1414c0 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c14a640 con 0x7fc09c0b5680 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0b9030 con 0x7fc09c14b120 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc09b400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc09c1414c0 0x7fc09c14f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34472/0 (socket says 172.21.15.119:34472) 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc09b400640 1 -- 172.21.15.119:0/3679555173 learned_addr learned my addr 172.21.15.119:0/3679555173 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:47.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a0a00640 1 --2- 172.21.15.119:0/3679555173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064322331 0 0) 0x7fc09c0b5a60 con 0x7fc09c1414c0 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc080003530 con 0x7fc09c1414c0 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a0a00640 1 -- 172.21.15.119:0/3679555173 >> v1:172.21.15.160:6789/0 conn(0x7fc09c0b5680 legacy=0x7fc09c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741493639 0 0) 0x7fc09c14a640 con 0x7fc09c0b5680 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a0a00640 1 -- 172.21.15.119:0/3679555173 >> v1:172.21.15.119:6789/0 conn(0x7fc09c1414c0 legacy=0x7fc09c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.492+0000 7fc0a0a00640 1 -- 172.21.15.119:0/3679555173 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c14a920 con 0x7fc09c14b120 2024-03-08T21:34:47.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a0a00640 1 --2- 172.21.15.119:0/3679555173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c0b4130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097f0 tx=0x7fc09401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21601f4355c8f7e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940b0070 con 0x7fc09c14b120 2024-03-08T21:34:47.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0940ab600 con 0x7fc09c14b120 2024-03-08T21:34:47.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc09aa00640 1 -- 172.21.15.119:0/3679555173 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940ab9d0 con 0x7fc09c14b120 2024-03-08T21:34:47.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3679555173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 msgr2=0x7fc09c0b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3679555173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c0b4130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc0940097f0 tx=0x7fc09401c3c0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3679555173 shutdown_connections 2024-03-08T21:34:47.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3679555173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c0b4130 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3679555173 >> 172.21.15.119:0/3679555173 conn(0x7fc09c072c70 msgr2=0x7fc09c0bc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:47.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3679555173 shutdown_connections 2024-03-08T21:34:47.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3679555173 wait complete. 2024-03-08T21:34:47.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.496+0000 7fc0a2a00640 1 Processor -- start 2024-03-08T21:34:47.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- start start 2024-03-08T21:34:47.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc09c0b5680 0x7fc09c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c1453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0b4a40 con 0x7fc09c1414c0 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c14ac90 con 0x7fc09c0b5680 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c1559d0 con 0x7fc09c14b120 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41440/0 (socket says 172.21.15.119:41440) 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 -- 172.21.15.119:0/3688104915 learned_addr learned my addr 172.21.15.119:0/3688104915 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 -- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 msgr2=0x7fc09c1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c1453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 -- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc09c0b5680 msgr2=0x7fc09c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc09c0b5680 0x7fc09c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 -- 172.21.15.119:0/3688104915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c147d10 con 0x7fc09c1414c0 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc09b400640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c420 tx=0x7fc08800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088017070 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088005d10 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088007310 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c1468e0 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c147ff0 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c067db0 con 0x7fc09c1414c0 2024-03-08T21:34:47.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.500+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fc08801a070 con 0x7fc09c1414c0 2024-03-08T21:34:47.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.504+0000 7fc093e00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 0x7fc07c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.504+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc088084d10 con 0x7fc09c1414c0 2024-03-08T21:34:47.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.504+0000 7fc09be00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 0x7fc07c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.504+0000 7fc09be00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 0x7fc07c069b20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001c90 tx=0x7fc08c007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.508+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fc08808a020 con 0x7fc09c1414c0 2024-03-08T21:34:47.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.696+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc09c0b8cf0 con 0x7fc09c1414c0 2024-03-08T21:34:47.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.696+0000 7fc093e00640 1 -- 172.21.15.119:0/3688104915 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7fc09c147d10 con 0x7fc09c1414c0 2024-03-08T21:34:47.688 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:47.688 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:47.688 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 msgr2=0x7fc07c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 0x7fc07c069b20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001c90 tx=0x7fc08c007cc0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 msgr2=0x7fc09c1e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c420 tx=0x7fc08800c8e0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 shutdown_connections 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fc07c067660 0x7fc07c069b20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc09c14b120 0x7fc09c1453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09c1414c0 0x7fc09c1e2f20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 --2- 172.21.15.119:0/3688104915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc09c0b5680 0x7fc09c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 >> 172.21.15.119:0/3688104915 conn(0x7fc09c072c70 msgr2=0x7fc09c0baa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 shutdown_connections 2024-03-08T21:34:47.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.700+0000 7fc0a2a00640 1 -- 172.21.15.119:0/3688104915 wait complete. 2024-03-08T21:34:47.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:47.816 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:34:47.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:34:47.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 Processor -- start 2024-03-08T21:34:47.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 -- start start 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f885c09a8d0 0x7f885c09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f885c0b1d30 0x7f885c0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0b2680 con 0x7f885c099ca0 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c0b4b60 con 0x7f885c0b1d30 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8861000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c09a080 con 0x7f885c09a8d0 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f885c0b1d30 0x7f885c0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f885c0b1d30 0x7f885c0b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41448/0 (socket says 172.21.15.119:41448) 2024-03-08T21:34:47.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 -- 172.21.15.119:0/1606484965 learned_addr learned my addr 172.21.15.119:0/1606484965 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8859e00640 1 --1- 172.21.15.119:0/1606484965 >> v1:172.21.15.119:6789/0 conn(0x7f885c099ca0 0x7f885c13ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34484/0 (socket says 172.21.15.119:34484) 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f8851400640 1 --2- 172.21.15.119:0/1606484965 >> v2:172.21.15.160:3300/0 conn(0x7f885c09a8d0 0x7f885c09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 -- 172.21.15.119:0/1606484965 >> v2:172.21.15.160:3300/0 conn(0x7f885c09a8d0 msgr2=0x7f885c09ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 --2- 172.21.15.119:0/1606484965 >> v2:172.21.15.160:3300/0 conn(0x7f885c09a8d0 0x7f885c09ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 -- 172.21.15.119:0/1606484965 >> v1:172.21.15.119:6789/0 conn(0x7f885c099ca0 legacy=0x7f885c13ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.852+0000 7f885a800640 1 -- 172.21.15.119:0/1606484965 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0b4510 con 0x7f885c0b1d30 2024-03-08T21:34:47.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f885a800640 1 --2- 172.21.15.119:0/1606484965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c0b2140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f885c09a330 tx=0x7f885401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f87e0e3255ddb72 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8859400640 1 -- 172.21.15.119:0/1606484965 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540ab430 con 0x7f885c0b1d30 2024-03-08T21:34:47.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8859400640 1 -- 172.21.15.119:0/1606484965 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540b0070 con 0x7f885c0b1d30 2024-03-08T21:34:47.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8859400640 1 -- 172.21.15.119:0/1606484965 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540ab7f0 con 0x7f885c0b1d30 2024-03-08T21:34:47.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 -- 172.21.15.119:0/1606484965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 msgr2=0x7f885c0b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 --2- 172.21.15.119:0/1606484965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c0b2140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f885c09a330 tx=0x7f885401c520 comp rx=0 tx=0).stop 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 -- 172.21.15.119:0/1606484965 shutdown_connections 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 --2- 172.21.15.119:0/1606484965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c0b2140 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 --2- 172.21.15.119:0/1606484965 >> v2:172.21.15.160:3300/0 conn(0x7f885c09a8d0 0x7f885c09ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 -- 172.21.15.119:0/1606484965 >> 172.21.15.119:0/1606484965 conn(0x7f885c06c620 msgr2=0x7f885c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 -- 172.21.15.119:0/1606484965 shutdown_connections 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.856+0000 7f8861000640 1 -- 172.21.15.119:0/1606484965 wait complete. 2024-03-08T21:34:47.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 Processor -- start 2024-03-08T21:34:47.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- start start 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885c099ca0 0x7f885c09bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 0x7f885c13cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1522d0 con 0x7f885c0b1d30 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c152150 con 0x7f885c099ca0 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c152450 con 0x7f885c09a8d0 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41464/0 (socket says 172.21.15.119:41464) 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 -- 172.21.15.119:0/2151407459 learned_addr learned my addr 172.21.15.119:0/2151407459 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8859e00640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885c099ca0 0x7f885c09bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8851400640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 0x7f885c13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 -- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 msgr2=0x7f885c13cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 0x7f885c13cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 -- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885c099ca0 msgr2=0x7f885c09bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885c099ca0 0x7f885c09bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 -- 172.21.15.119:0/2151407459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c09d120 con 0x7f885c0b1d30 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8851400640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 0x7f885c13cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f885a800640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f885401a150 tx=0x7f885401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540abe60 con 0x7f885c0b1d30 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540be5f0 con 0x7f885c0b1d30 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0aff50 con 0x7f885c0b1d30 2024-03-08T21:34:47.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540be9e0 con 0x7f885c0b1d30 2024-03-08T21:34:47.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.860+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c09ce40 con 0x7f885c0b1d30 2024-03-08T21:34:47.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c0b0fb0 con 0x7f885c0b1d30 2024-03-08T21:34:47.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f88540c7430 con 0x7f885c0b1d30 2024-03-08T21:34:47.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8852a00640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 0x7f8838069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:47.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88540a8030 con 0x7f885c0b1d30 2024-03-08T21:34:47.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8859e00640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 0x7f8838069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:47.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.864+0000 7f8859e00640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 0x7f8838069b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f885c09d5b0 tx=0x7f884c001640 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:47.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:47.868+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f8854016110 con 0x7f885c0b1d30 2024-03-08T21:34:48.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.024+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f885c0b8330 con 0x7f885c0b1d30 2024-03-08T21:34:48.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.024+0000 7f8852a00640 1 -- 172.21.15.119:0/2151407459 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f88540f0700 con 0x7f885c0b1d30 2024-03-08T21:34:48.014 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:48.015 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:32.540475+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 msgr2=0x7f8838069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 0x7f8838069b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f885c09d5b0 tx=0x7f884c001640 comp rx=0 tx=0).stop 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 msgr2=0x7f885c1e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f885401a150 tx=0x7f885401ad60 comp rx=0 tx=0).stop 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 shutdown_connections 2024-03-08T21:34:48.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8838067660 0x7f8838069b20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f885c0b1d30 0x7f885c1e3580 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885c09a8d0 0x7f885c13cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 --2- 172.21.15.119:0/2151407459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885c099ca0 0x7f885c09bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 >> 172.21.15.119:0/2151407459 conn(0x7f885c06c620 msgr2=0x7f885c0b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 shutdown_connections 2024-03-08T21:34:48.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.028+0000 7f8861000640 1 -- 172.21.15.119:0/2151407459 wait complete. 2024-03-08T21:34:48.035 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T21:34:48.036 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 Processor -- start 2024-03-08T21:34:48.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 -- start start 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2910072fe0 0x7f291009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291009b190 con 0x7f29101448b0 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291009d240 con 0x7f291009adb0 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2917c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291009d520 con 0x7f2910072fe0 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2915c00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f29101448b0 0x7f291013d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34488/0 (socket says 172.21.15.119:34488) 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2915c00640 1 -- 172.21.15.119:0/1152006965 learned_addr learned my addr 172.21.15.119:0/1152006965 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:48.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f2907e00640 1 --2- 172.21.15.119:0/1152006965 >> v2:172.21.15.160:3300/0 conn(0x7f2910072fe0 0x7f291009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035924161 0 0) 0x7f291009b190 con 0x7f29101448b0 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.180+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f4005740 con 0x7f29101448b0 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101190303 0 0) 0x7f291009d240 con 0x7f291009adb0 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f291009b190 con 0x7f291009adb0 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f2907e00640 1 -- 172.21.15.119:0/1152006965 >> v1:172.21.15.160:6789/0 conn(0x7f291009adb0 legacy=0x7f29101441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f2907e00640 1 -- 172.21.15.119:0/1152006965 >> v1:172.21.15.119:6789/0 conn(0x7f29101448b0 legacy=0x7f291013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f2907e00640 1 -- 172.21.15.119:0/1152006965 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910143c50 con 0x7f2910072fe0 2024-03-08T21:34:48.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f2907e00640 1 --2- 172.21.15.119:0/1152006965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f291009cbf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bda37b47795a08e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80b1070 con 0x7f2910072fe0 2024-03-08T21:34:48.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f80ac620 con 0x7f2910072fe0 2024-03-08T21:34:48.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.184+0000 7f290fe00640 1 -- 172.21.15.119:0/1152006965 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80ac9f0 con 0x7f2910072fe0 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/1152006965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 msgr2=0x7f291009cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 --2- 172.21.15.119:0/1152006965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f291009cbf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f801c4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/1152006965 shutdown_connections 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 --2- 172.21.15.119:0/1152006965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f291009cbf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/1152006965 >> 172.21.15.119:0/1152006965 conn(0x7f291006c620 msgr2=0x7f291006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/1152006965 shutdown_connections 2024-03-08T21:34:48.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/1152006965 wait complete. 2024-03-08T21:34:48.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 Processor -- start 2024-03-08T21:34:48.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- start start 2024-03-08T21:34:48.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f2910137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29101448b0 0x7f29101405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291009a5e0 con 0x7f291009adb0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291009a460 con 0x7f2910072fe0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291009a760 con 0x7f29101448b0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41470/0 (socket says 172.21.15.119:41470) 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 -- 172.21.15.119:0/3110708932 learned_addr learned my addr 172.21.15.119:0/3110708932 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2915c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29101448b0 0x7f29101405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2915200640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f2910137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 -- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29101448b0 msgr2=0x7f29101405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29101448b0 0x7f29101405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 -- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 msgr2=0x7f2910137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f2910137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 -- 172.21.15.119:0/3110708932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910072b30 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2915200640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f2910137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2907e00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80b9020 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f80b5410 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29100b0060 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80b1040 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.188+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291014f360 con 0x7f291009adb0 2024-03-08T21:34:48.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2910067db0 con 0x7f291009adb0 2024-03-08T21:34:48.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f28f80bc020 con 0x7f291009adb0 2024-03-08T21:34:48.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f290d600640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 0x7f28ec069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f811f320 con 0x7f291009adb0 2024-03-08T21:34:48.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f2915200640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 0x7f28ec069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.192+0000 7f2915200640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 0x7f28ec069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29000011f0 tx=0x7f2900009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.196+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f28f80c3030 con 0x7f291009adb0 2024-03-08T21:34:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29101de580 con 0x7f291009adb0 2024-03-08T21:34:48.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f290d600640 1 -- 172.21.15.119:0/3110708932 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7f2910072b30 con 0x7f291009adb0 2024-03-08T21:34:48.374 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:48.374 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:48.374 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 msgr2=0x7f28ec069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 0x7f28ec069b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f29000011f0 tx=0x7f2900009040 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 msgr2=0x7f29101decf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097c0 tx=0x7f28f8019240 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 shutdown_connections 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28ec067660 0x7f28ec069b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29101448b0 0x7f29101405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f291009adb0 0x7f29101decf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 --2- 172.21.15.119:0/3110708932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2910072fe0 0x7f2910137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.384+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 >> 172.21.15.119:0/3110708932 conn(0x7f291006c620 msgr2=0x7f291013d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.388+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 shutdown_connections 2024-03-08T21:34:48.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.388+0000 7f2917c00640 1 -- 172.21.15.119:0/3110708932 wait complete. 2024-03-08T21:34:48.394 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:34:48.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 Processor -- start 2024-03-08T21:34:48.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 -- start start 2024-03-08T21:34:48.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f629409a8d0 0x7f629409ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629409a080 con 0x7f6294099ca0 2024-03-08T21:34:48.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62940b4510 con 0x7f62940b1d30 2024-03-08T21:34:48.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f629a400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62940b4b60 con 0x7f629409a8d0 2024-03-08T21:34:48.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6294099ca0 0x7f629413ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34504/0 (socket says 172.21.15.119:34504) 2024-03-08T21:34:48.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293400640 1 -- 172.21.15.119:0/1351044616 learned_addr learned my addr 172.21.15.119:0/1351044616 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f628aa00640 1 --2- 172.21.15.119:0/1351044616 >> v2:172.21.15.160:3300/0 conn(0x7f629409a8d0 0x7f629409ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483963581 0 0) 0x7f629409a080 con 0x7f6294099ca0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6278003530 con 0x7f6294099ca0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094304309 0 0) 0x7f6278003530 con 0x7f6294099ca0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 >> v2:172.21.15.160:3300/0 conn(0x7f629409a8d0 msgr2=0x7f629409ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 --2- 172.21.15.119:0/1351044616 >> v2:172.21.15.160:3300/0 conn(0x7f629409a8d0 0x7f629409ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 >> v1:172.21.15.160:6789/0 conn(0x7f62940b1d30 legacy=0x7f62940b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940b47f0 con 0x7f6294099ca0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f6284001a00 con 0x7f6294099ca0 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 >> v1:172.21.15.119:6789/0 conn(0x7f6294099ca0 legacy=0x7f629413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62780039c0 0x7f6278003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6278004810 0x7f6278004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 0x7f627800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940b4b60 con 0x7f62780051d0 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627800c070 con 0x7f62780039c0 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627800c270 con 0x7f6278004810 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 0x7f627800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f628aa00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6278004810 0x7f6278004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293400640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62780039c0 0x7f6278003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 -- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6278004810 msgr2=0x7f6278004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6278004810 0x7f6278004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 -- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62780039c0 msgr2=0x7f6278003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62780039c0 0x7f6278003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.540+0000 7f6293e00640 1 -- 172.21.15.119:0/1351044616 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278003530 con 0x7f62780051d0 2024-03-08T21:34:48.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f6293e00640 1 -- 172.21.15.119:0/1351044616 reap_dead start 2024-03-08T21:34:48.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f6293e00640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 0x7f627800b9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f628c001780 tx=0x7f628c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2c9932f74bcd7b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0013a0 con 0x7f62780051d0 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0a9070 con 0x7f62780051d0 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f6292a00640 1 -- 172.21.15.119:0/1351044616 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c003600 con 0x7f62780051d0 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 -- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 msgr2=0x7f627800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 0x7f627800b9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f628c001780 tx=0x7f628c01c420 comp rx=0 tx=0).stop 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 -- 172.21.15.119:0/1351044616 shutdown_connections 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 --2- 172.21.15.119:0/1351044616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62780051d0 0x7f627800b9d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 -- 172.21.15.119:0/1351044616 >> 172.21.15.119:0/1351044616 conn(0x7f629406c620 msgr2=0x7f629406ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 -- 172.21.15.119:0/1351044616 shutdown_connections 2024-03-08T21:34:48.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.544+0000 7f629a400640 1 -- 172.21.15.119:0/1351044616 wait complete. 2024-03-08T21:34:48.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 Processor -- start 2024-03-08T21:34:48.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- start start 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 0x7f629413a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 0x7f629409c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629409b0d0 con 0x7f629409c6d0 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629409af50 con 0x7f629409b9b0 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62940b3d20 con 0x7f62780051d0 2024-03-08T21:34:48.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41488/0 (socket says 172.21.15.119:41488) 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 -- 172.21.15.119:0/1180419701 learned_addr learned my addr 172.21.15.119:0/1180419701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 0x7f629413a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f628aa00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 0x7f629409c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 -- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 msgr2=0x7f629413a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 0x7f629413a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 -- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 msgr2=0x7f629409c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 0x7f629409c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 -- 172.21.15.119:0/1180419701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629413add0 con 0x7f629409c6d0 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f628aa00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 0x7f629409c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 0x7f629413a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:48.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f6293e00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f628c01ccc0 tx=0x7f6278005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c0013a0 con 0x7f629409c6d0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c004b50 con 0x7f629409c6d0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c007a40 con 0x7f629409c6d0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629409d520 con 0x7f629409c6d0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.548+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629409be30 con 0x7f629409c6d0 2024-03-08T21:34:48.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6294067db0 con 0x7f629409c6d0 2024-03-08T21:34:48.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f628c0ab070 con 0x7f629409c6d0 2024-03-08T21:34:48.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f628be00640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 0x7f6270069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f628c11ead0 con 0x7f629409c6d0 2024-03-08T21:34:48.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f6293400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 0x7f6270069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.552+0000 7f6293400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 0x7f6270069b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6284005c40 tx=0x7f6284001260 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.556+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f628c016130 con 0x7f629409c6d0 2024-03-08T21:34:48.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.744+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6294145310 con 0x7f629409c6d0 2024-03-08T21:34:48.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.744+0000 7f628be00640 1 -- 172.21.15.119:0/1180419701 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3359 (secure 0 0 0) 0x7f628c0ef740 con 0x7f629409c6d0 2024-03-08T21:34:48.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:48.736 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T21:34:30.907729+0000","modified":"2024-03-08T21:34:33.932128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5007},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5007":{"gid":5007,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6835/3038640532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3038640532},{"type":"v1","addr":"172.21.15.119:6835","nonce":3038640532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T21:34:48.736 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 17 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 msgr2=0x7f6270069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 0x7f6270069b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6284005c40 tx=0x7f6284001260 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 msgr2=0x7f62940afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f628c01ccc0 tx=0x7f6278005840 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 shutdown_connections 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6270067660 0x7f6270069b20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f629409c6d0 0x7f62940afa20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f629409b9b0 0x7f629409c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 --2- 172.21.15.119:0/1180419701 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62780051d0 0x7f629413a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 >> 172.21.15.119:0/1180419701 conn(0x7f629406c620 msgr2=0x7f629413eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 shutdown_connections 2024-03-08T21:34:48.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.748+0000 7f629a400640 1 -- 172.21.15.119:0/1180419701 wait complete. 2024-03-08T21:34:48.757 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 Processor -- start 2024-03-08T21:34:48.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 -- start start 2024-03-08T21:34:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f787406da10 0x7f78740b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78740b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787406ddf0 con 0x7f7874140d70 2024-03-08T21:34:48.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740b6190 con 0x7f787406da10 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7879e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78740b4570 con 0x7f78740b6440 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7874140d70 0x7f78741411c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34506/0 (socket says 172.21.15.119:34506) 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 -- 172.21.15.119:0/1247334317 learned_addr learned my addr 172.21.15.119:0/1247334317 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7872000640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78740b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7872a00640 1 --2- 172.21.15.119:0/1247334317 >> v2:172.21.15.160:3300/0 conn(0x7f787406da10 0x7f78740b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958770455 0 0) 0x7f787406ddf0 con 0x7f7874140d70 2024-03-08T21:34:48.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7858003530 con 0x7f7874140d70 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 433589606 0 0) 0x7f7858003530 con 0x7f7874140d70 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 msgr2=0x7f78740b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78740b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 >> v2:172.21.15.160:3300/0 conn(0x7f787406da10 msgr2=0x7f78740b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 --2- 172.21.15.119:0/1247334317 >> v2:172.21.15.160:3300/0 conn(0x7f787406da10 0x7f78740b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740b4850 con 0x7f7874140d70 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f786c001a00 con 0x7f7874140d70 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7872000640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78740b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 >> v1:172.21.15.119:6789/0 conn(0x7f7874140d70 legacy=0x7f78741411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78580039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7858003f00 0x7f7858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f78580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740b6190 con 0x7f7858004d50 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740b4570 con 0x7f7858003f00 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785800ba80 con 0x7f78740b6440 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f78580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7872a00640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78580039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7872000640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7858003f00 0x7f7858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 -- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 msgr2=0x7f78580039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b6440 0x7f78580039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 -- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7858003f00 msgr2=0x7f7858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7858003f00 0x7f7858004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.904+0000 7f7873400640 1 -- 172.21.15.119:0/1247334317 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858003530 con 0x7f7858004d50 2024-03-08T21:34:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7873400640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f78580051d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f786c00a880 tx=0x7f786c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea0befd3c335f42 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00a4a0 con 0x7f7858004d50 2024-03-08T21:34:48.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c0ad650 con 0x7f7858004d50 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7871600640 1 -- 172.21.15.119:0/1247334317 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0ada80 con 0x7f7858004d50 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 -- 172.21.15.119:0/1247334317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 msgr2=0x7f78580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 --2- 172.21.15.119:0/1247334317 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f78580051d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f786c00a880 tx=0x7f786c01d3a0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7873400640 1 -- 172.21.15.119:0/1247334317 reap_dead start 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 -- 172.21.15.119:0/1247334317 shutdown_connections 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 -- 172.21.15.119:0/1247334317 >> 172.21.15.119:0/1247334317 conn(0x7f787406b6e0 msgr2=0x7f78740ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 -- 172.21.15.119:0/1247334317 shutdown_connections 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.908+0000 7f7879e00640 1 -- 172.21.15.119:0/1247334317 wait complete. 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 Processor -- start 2024-03-08T21:34:48.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- start start 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 0x7f78741df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78740ba0a0 0x7f78741dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7874152270 con 0x7f7858004d50 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78741523f0 con 0x7f78740ba0a0 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7874152570 con 0x7f78740b8a00 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41494/0 (socket says 172.21.15.119:41494) 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 -- 172.21.15.119:0/3562326459 learned_addr learned my addr 172.21.15.119:0/3562326459 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7873400640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78740ba0a0 0x7f78741dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872000640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 0x7f78741df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 -- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 msgr2=0x7f78741df9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 0x7f78741df9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 -- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78740ba0a0 msgr2=0x7f78741dfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78740ba0a0 0x7f78741dfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 -- 172.21.15.119:0/3562326459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740b9930 con 0x7f7858004d50 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872000640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 0x7f78741df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7872a00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7864011980 tx=0x7f7864011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400faf0 con 0x7f7858004d50 2024-03-08T21:34:48.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400fc90 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7874139620 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864014440 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.912+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78741389c0 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7874067db0 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7864012040 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f786b400640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 0x7f7854069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7864085f60 con 0x7f7858004d50 2024-03-08T21:34:48.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f7872000640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 0x7f7854069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.916+0000 7f7872000640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 0x7f7854069b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78740b5940 tx=0x7f7860008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:48.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:48.920+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7864019030 con 0x7f7858004d50 2024-03-08T21:34:49.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.076+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78741479b0 con 0x7f7858004d50 2024-03-08T21:34:49.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.076+0000 7f786b400640 1 -- 172.21.15.119:0/3562326459 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f7864056600 con 0x7f7858004d50 2024-03-08T21:34:49.066 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:49.066 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":30,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:32.540475+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T21:34:28.565574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T21:34:29.908148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 msgr2=0x7f7854069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 0x7f7854069b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78740b5940 tx=0x7f7860008040 comp rx=0 tx=0).stop 2024-03-08T21:34:49.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 msgr2=0x7f7874138480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7864011980 tx=0x7f7864011e40 comp rx=0 tx=0).stop 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 shutdown_connections 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7854067660 0x7f7854069b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78740ba0a0 0x7f78741dfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78740b8a00 0x7f78741df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 --2- 172.21.15.119:0/3562326459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7858004d50 0x7f7874138480 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 >> 172.21.15.119:0/3562326459 conn(0x7f787406b6e0 msgr2=0x7f7874147020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 shutdown_connections 2024-03-08T21:34:49.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.080+0000 7f7879e00640 1 -- 172.21.15.119:0/3562326459 wait complete. 2024-03-08T21:34:49.087 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-08T21:34:49.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.232+0000 7fbad8400640 1 Processor -- start 2024-03-08T21:34:49.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.232+0000 7fbad8400640 1 -- start start 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad8400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbad009adb0 0x7fbad009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad8400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbad013d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad8400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad009b190 con 0x7fbad0072fe0 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad8400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad009d240 con 0x7fbad009adb0 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad8400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad009d520 con 0x7fbad01448b0 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbad0072fe0 0x7fbad01441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34516/0 (socket says 172.21.15.119:34516) 2024-03-08T21:34:49.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5000640 1 -- 172.21.15.119:0/2803359655 learned_addr learned my addr 172.21.15.119:0/2803359655 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbad013d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5a00640 1 --2- 172.21.15.119:0/2803359655 >> v2:172.21.15.160:3300/0 conn(0x7fbad009adb0 0x7fbad009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912538778 0 0) 0x7fbad009b190 con 0x7fbad0072fe0 2024-03-08T21:34:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003530 con 0x7fbad0072fe0 2024-03-08T21:34:49.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869551399 0 0) 0x7fbab8003530 con 0x7fbad0072fe0 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 msgr2=0x7fbad013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbad013d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 >> v2:172.21.15.160:3300/0 conn(0x7fbad009adb0 msgr2=0x7fbad009cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 --2- 172.21.15.119:0/2803359655 >> v2:172.21.15.160:3300/0 conn(0x7fbad009adb0 0x7fbad009cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0143c50 con 0x7fbad0072fe0 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7fbabc001680 con 0x7fbad0072fe0 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbad013d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 >> v1:172.21.15.119:6789/0 conn(0x7fbad0072fe0 legacy=0x7fbad01441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbab80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab8003f00 0x7fbab8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbab80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad009d240 con 0x7fbab8004d50 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad009d520 con 0x7fbab8003f00 2024-03-08T21:34:49.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800b9d0 con 0x7fbad01448b0 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbab80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5000640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab8003f00 0x7fbab8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5a00640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbab80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 -- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 msgr2=0x7fbab80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad01448b0 0x7fbab80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 -- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab8003f00 msgr2=0x7fbab8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab8003f00 0x7fbab8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad6400640 1 -- 172.21.15.119:0/2803359655 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8003530 con 0x7fbab8004d50 2024-03-08T21:34:49.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.236+0000 7fbad5000640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbab8003f00 0x7fbab8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad6400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbab80051d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009cb0 tx=0x7fbac801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bd3b259bfb0a35 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80b2070 con 0x7fbab8004d50 2024-03-08T21:34:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80a58d0 con 0x7fbab8004d50 2024-03-08T21:34:49.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbacfe00640 1 -- 172.21.15.119:0/2803359655 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8009880 con 0x7fbab8004d50 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- 172.21.15.119:0/2803359655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 msgr2=0x7fbab80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 --2- 172.21.15.119:0/2803359655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbab80051d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009cb0 tx=0x7fbac801cc10 comp rx=0 tx=0).stop 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad6400640 1 -- 172.21.15.119:0/2803359655 reap_dead start 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- 172.21.15.119:0/2803359655 shutdown_connections 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- 172.21.15.119:0/2803359655 >> 172.21.15.119:0/2803359655 conn(0x7fbad006c620 msgr2=0x7fbad006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- 172.21.15.119:0/2803359655 shutdown_connections 2024-03-08T21:34:49.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- 172.21.15.119:0/2803359655 wait complete. 2024-03-08T21:34:49.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 Processor -- start 2024-03-08T21:34:49.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.240+0000 7fbad8400640 1 -- start start 2024-03-08T21:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad00ae7f0 0x7fbad01dd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 0x7fbad013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad013db60 con 0x7fbab8004d50 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad013d9e0 con 0x7fbad013a2a0 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad013dce0 con 0x7fbad00ae7f0 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41512/0 (socket says 172.21.15.119:41512) 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 -- 172.21.15.119:0/2170574174 learned_addr learned my addr 172.21.15.119:0/2170574174 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5000640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad00ae7f0 0x7fbad01dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad6400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 0x7fbad013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 -- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad00ae7f0 msgr2=0x7fbad01dd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad00ae7f0 0x7fbad01dd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 -- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 msgr2=0x7fbad013a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 0x7fbad013a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 -- 172.21.15.119:0/2170574174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad013ac60 con 0x7fbab8004d50 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad6400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 0x7fbad013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad5a00640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbac4011e90 tx=0x7fbac400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4015630 con 0x7fbab8004d50 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac40157d0 con 0x7fbab8004d50 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4015ba0 con 0x7fbab8004d50 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad01414c0 con 0x7fbab8004d50 2024-03-08T21:34:49.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad00af1b0 con 0x7fbab8004d50 2024-03-08T21:34:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad0067db0 con 0x7fbab8004d50 2024-03-08T21:34:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.244+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbac401d400 con 0x7fbab8004d50 2024-03-08T21:34:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.248+0000 7fbacd600640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 0x7fbab0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.248+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbac4086b30 con 0x7fbab8004d50 2024-03-08T21:34:49.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.248+0000 7fbad5000640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 0x7fbab0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.248+0000 7fbad5000640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 0x7fbab0069b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbad01de7e0 tx=0x7fbabc007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.252+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fbac4019030 con 0x7fbab8004d50 2024-03-08T21:34:49.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.452+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbad00aebd0 con 0x7fbab8004d50 2024-03-08T21:34:49.440 INFO:tasks.ceph.mon.a.smithi119.stderr:2024-03-08T21:34:49.452+0000 7fad3cc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-08T21:34:49.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.452+0000 7fbacd600640 1 -- 172.21.15.119:0/2170574174 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbac4010040 con 0x7fbab8004d50 2024-03-08T21:34:49.442 INFO:teuthology.orchestra.run.smithi119.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 msgr2=0x7fbab0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 0x7fbab0069b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbad01de7e0 tx=0x7fbabc007040 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 msgr2=0x7fbad013ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbac4011e90 tx=0x7fbac400f580 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 shutdown_connections 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbab0067660 0x7fbab0069b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbad013a2a0 0x7fbad013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbad00ae7f0 0x7fbad01dd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 --2- 172.21.15.119:0/2170574174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab8004d50 0x7fbad013ef30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 >> 172.21.15.119:0/2170574174 conn(0x7fbad006c620 msgr2=0x7fbad006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:49.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 shutdown_connections 2024-03-08T21:34:49.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.456+0000 7fbad8400640 1 -- 172.21.15.119:0/2170574174 wait complete. 2024-03-08T21:34:49.451 INFO:tasks.ceph.mds.a.smithi119.stderr: -2613> 2024-03-08T21:34:34.489+0000 7f8efec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T21:34:49.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-08T21:34:49.498 INFO:tasks.ceph.mds.a.smithi119.stdout:starting mds.a at 2024-03-08T21:34:49.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 Processor -- start 2024-03-08T21:34:49.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 -- start start 2024-03-08T21:34:49.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb1f00b42b0 0x7fb1f006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f006e0b0 con 0x7fb1f0145b30 2024-03-08T21:34:49.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f0145050 con 0x7fb1f00b4690 2024-03-08T21:34:49.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f7a00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f0142a90 con 0x7fb1f00b42b0 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1efe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb1f0145b30 0x7fb1f0142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34518/0 (socket says 172.21.15.119:34518) 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1efe00640 1 -- 172.21.15.119:0/1939856165 learned_addr learned my addr 172.21.15.119:0/1939856165 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f5000640 1 --2- 172.21.15.119:0/1939856165 >> v2:172.21.15.160:3300/0 conn(0x7fb1f00b42b0 0x7fb1f006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1ef400640 1 -- 172.21.15.119:0/1939856165 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280670785 0 0) 0x7fb1f006e0b0 con 0x7fb1f0145b30 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1ef400640 1 -- 172.21.15.119:0/1939856165 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d8003530 con 0x7fb1f0145b30 2024-03-08T21:34:49.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f5000640 1 -- 172.21.15.119:0/1939856165 >> v1:172.21.15.160:6789/0 conn(0x7fb1f00b4690 legacy=0x7fb1f014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f5000640 1 -- 172.21.15.119:0/1939856165 >> v1:172.21.15.119:6789/0 conn(0x7fb1f0145b30 legacy=0x7fb1f0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.616+0000 7fb1f5000640 1 -- 172.21.15.119:0/1939856165 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0145330 con 0x7fb1f00b42b0 2024-03-08T21:34:49.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f5000640 1 --2- 172.21.15.119:0/1939856165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f00b42b0 0x7fb1f006c5e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ac2a50e96d1b40 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1ef400640 1 -- 172.21.15.119:0/1939856165 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40b0070 con 0x7fb1f00b42b0 2024-03-08T21:34:49.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1ef400640 1 -- 172.21.15.119:0/1939856165 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e40ab600 con 0x7fb1f00b42b0 2024-03-08T21:34:49.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1ef400640 1 -- 172.21.15.119:0/1939856165 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40ab9d0 con 0x7fb1f00b42b0 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- 172.21.15.119:0/1939856165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f00b42b0 msgr2=0x7fb1f006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/1939856165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f00b42b0 0x7fb1f006c5e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097c0 tx=0x7fb1e401c410 comp rx=0 tx=0).stop 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- 172.21.15.119:0/1939856165 shutdown_connections 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/1939856165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f00b42b0 0x7fb1f006c5e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- 172.21.15.119:0/1939856165 >> 172.21.15.119:0/1939856165 conn(0x7fb1f009a230 msgr2=0x7fb1f009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- 172.21.15.119:0/1939856165 shutdown_connections 2024-03-08T21:34:49.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- 172.21.15.119:0/1939856165 wait complete. 2024-03-08T21:34:49.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 Processor -- start 2024-03-08T21:34:49.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.620+0000 7fb1f7a00640 1 -- start start 2024-03-08T21:34:49.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1f00b42b0 0x7fb1f013cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f0145b30 0x7fb1f01e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f0153830 con 0x7fb1f00b4690 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00b3850 con 0x7fb1f0145b30 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f01539b0 con 0x7fb1f00b42b0 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f5000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1f00b42b0 0x7fb1f013cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41544/0 (socket says 172.21.15.119:41544) 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 -- 172.21.15.119:0/3018746542 learned_addr learned my addr 172.21.15.119:0/3018746542 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f5a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f0145b30 0x7fb1f01e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 -- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1f00b42b0 msgr2=0x7fb1f013cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1f00b42b0 0x7fb1f013cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 -- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f0145b30 msgr2=0x7fb1f01e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f0145b30 0x7fb1f01e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 -- 172.21.15.119:0/3018746542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0137400 con 0x7fb1f00b4690 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1efe00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc001ec0 tx=0x7fb1dc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc017070 con 0x7fb1f00b4690 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc005d50 con 0x7fb1f00b4690 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f013c200 con 0x7fb1f00b4690 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc007270 con 0x7fb1f00b4690 2024-03-08T21:34:49.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f0137080 con 0x7fb1f00b4690 2024-03-08T21:34:49.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f0067db0 con 0x7fb1f00b4690 2024-03-08T21:34:49.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.624+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb1dc01a070 con 0x7fb1f00b4690 2024-03-08T21:34:49.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.628+0000 7fb1ecc00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 0x7fb1d0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:49.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.628+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb1dc084c10 con 0x7fb1f00b4690 2024-03-08T21:34:49.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.628+0000 7fb1f5000640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 0x7fb1d0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:49.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.628+0000 7fb1f5000640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 0x7fb1d0069b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40ad000 tx=0x7fb1e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:49.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.632+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb1dc055290 con 0x7fb1f00b4690 2024-03-08T21:34:49.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:49.820+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb1f0139e20 con 0x7fb1f00b4690 2024-03-08T21:34:50.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1ecc00640 1 -- 172.21.15.119:0/3018746542 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb1dc059330 con 0x7fb1f00b4690 2024-03-08T21:34:50.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 msgr2=0x7fb1d0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 0x7fb1d0069b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40ad000 tx=0x7fb1e4008040 comp rx=0 tx=0).stop 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 msgr2=0x7fb1f00aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc001ec0 tx=0x7fb1dc00c960 comp rx=0 tx=0).stop 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 shutdown_connections 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb1d0067660 0x7fb1d0069b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1f0145b30 0x7fb1f01e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1f00b4690 0x7fb1f00aef60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 --2- 172.21.15.119:0/3018746542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1f00b42b0 0x7fb1f013cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 >> 172.21.15.119:0/3018746542 conn(0x7fb1f009a230 msgr2=0x7fb1f0142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 shutdown_connections 2024-03-08T21:34:50.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.456+0000 7fb1f7a00640 1 -- 172.21.15.119:0/3018746542 wait complete. 2024-03-08T21:34:50.472 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-08T21:34:50.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 Processor -- start 2024-03-08T21:34:50.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 -- start start 2024-03-08T21:34:50.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4f80b42b0 0x7fa4f806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f8145b30 0x7fa4f8142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 0x7fa4f81483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f81456a0 con 0x7fa4f80b42b0 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80b3850 con 0x7fa4f80b4690 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4fce00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f806e0b0 con 0x7fa4f8145b30 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4f80b42b0 0x7fa4f806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4f80b42b0 0x7fa4f806c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41546/0 (socket says 172.21.15.119:41546) 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 -- 172.21.15.119:0/592098631 learned_addr learned my addr 172.21.15.119:0/592098631 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f6800640 1 --2- 172.21.15.119:0/592098631 >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 0x7fa4f81483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4ed400640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f8145b30 0x7fa4f8142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 -- 172.21.15.119:0/592098631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f8145b30 msgr2=0x7fa4f8142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:50.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f8145b30 0x7fa4f8142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 -- 172.21.15.119:0/592098631 >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 msgr2=0x7fa4f81483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:50.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 --2- 172.21.15.119:0/592098631 >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 0x7fa4f81483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f5e00640 1 -- 172.21.15.119:0/592098631 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8145050 con 0x7fa4f80b42b0 2024-03-08T21:34:50.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.668+0000 7fa4f6800640 1 --2- 172.21.15.119:0/592098631 >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 0x7fa4f81483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:50.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4f5e00640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f80b42b0 0x7fa4f806c5e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806f5e0 tx=0x7fa4e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842939c34c7bce79 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4f5400640 1 -- 172.21.15.119:0/592098631 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80b0070 con 0x7fa4f80b42b0 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4f5400640 1 -- 172.21.15.119:0/592098631 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80ab600 con 0x7fa4f80b42b0 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4f5400640 1 -- 172.21.15.119:0/592098631 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80ab9d0 con 0x7fa4f80b42b0 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- 172.21.15.119:0/592098631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f80b42b0 msgr2=0x7fa4f806c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f80b42b0 0x7fa4f806c5e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806f5e0 tx=0x7fa4e801c490 comp rx=0 tx=0).stop 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- 172.21.15.119:0/592098631 shutdown_connections 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 --2- 172.21.15.119:0/592098631 >> v2:172.21.15.160:3300/0 conn(0x7fa4f80b4690 0x7fa4f81483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f8145b30 0x7fa4f8142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 --2- 172.21.15.119:0/592098631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f80b42b0 0x7fa4f806c5e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- 172.21.15.119:0/592098631 >> 172.21.15.119:0/592098631 conn(0x7fa4f809a230 msgr2=0x7fa4f809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:50.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- 172.21.15.119:0/592098631 shutdown_connections 2024-03-08T21:34:50.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- 172.21.15.119:0/592098631 wait complete. 2024-03-08T21:34:50.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 Processor -- start 2024-03-08T21:34:50.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.672+0000 7fa4fce00640 1 -- start start 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f80b42b0 0x7fa4f8149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4f80b4690 0x7fa4f814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8151870 con 0x7fa4f8145b30 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81516f0 con 0x7fa4f80b4690 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81519f0 con 0x7fa4f80b42b0 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f5e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f80b42b0 0x7fa4f8149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41556/0 (socket says 172.21.15.119:41556) 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 -- 172.21.15.119:0/198401224 learned_addr learned my addr 172.21.15.119:0/198401224 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4ed400640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4f80b4690 0x7fa4f814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 -- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f80b42b0 msgr2=0x7fa4f8149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f80b42b0 0x7fa4f8149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 -- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4f80b4690 msgr2=0x7fa4f814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4f80b4690 0x7fa4f814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 -- 172.21.15.119:0/198401224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f814b400 con 0x7fa4f8145b30 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4f6800640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007e10 tx=0x7fa4f000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f001a070 con 0x7fa4f8145b30 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0003ba0 con 0x7fa4f8145b30 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0004030 con 0x7fa4f8145b30 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f8072220 con 0x7fa4f8145b30 2024-03-08T21:34:50.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f814b120 con 0x7fa4f8145b30 2024-03-08T21:34:50.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f814f4d0 con 0x7fa4f8145b30 2024-03-08T21:34:50.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.676+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa4f001d070 con 0x7fa4f8145b30 2024-03-08T21:34:50.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.680+0000 7fa4eea00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 0x7fa4d4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:50.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.680+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa4f0085ab0 con 0x7fa4f8145b30 2024-03-08T21:34:50.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.680+0000 7fa4f5e00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 0x7fa4d4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:50.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.680+0000 7fa4f5e00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 0x7fa4d4069b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806eb90 tx=0x7fa4e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:50.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.684+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa4f0010070 con 0x7fa4f8145b30 2024-03-08T21:34:50.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:50.840+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4f8067db0 con 0x7fa4f8145b30 2024-03-08T21:34:51.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.616+0000 7fa4eea00640 1 -- 172.21.15.119:0/198401224 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa4f00560f0 con 0x7fa4f8145b30 2024-03-08T21:34:51.607 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_metadata' removed 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 msgr2=0x7fa4d4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 0x7fa4d4069b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4f806eb90 tx=0x7fa4e8009040 comp rx=0 tx=0).stop 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 msgr2=0x7fa4f814ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007e10 tx=0x7fa4f000d4a0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 shutdown_connections 2024-03-08T21:34:51.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa4d4067660 0x7fa4d4069b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4f8145b30 0x7fa4f814ef90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4f80b4690 0x7fa4f814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 --2- 172.21.15.119:0/198401224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa4f80b42b0 0x7fa4f8149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 >> 172.21.15.119:0/198401224 conn(0x7fa4f809a230 msgr2=0x7fa4f8073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 shutdown_connections 2024-03-08T21:34:51.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.620+0000 7fa4fce00640 1 -- 172.21.15.119:0/198401224 wait complete. 2024-03-08T21:34:51.637 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-08T21:34:51.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 Processor -- start 2024-03-08T21:34:51.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 -- start start 2024-03-08T21:34:51.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0bcc145b30 0x7f0bcc142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:51.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc06e0b0 con 0x7f0bcc0b4690 2024-03-08T21:34:51.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc145050 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bd1200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc1456a0 con 0x7f0bcc145b30 2024-03-08T21:34:51.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bca800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0bcc0b4690 0x7f0bcc14f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:34522/0 (socket says 172.21.15.119:34522) 2024-03-08T21:34:51.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.788+0000 7f0bca800640 1 -- 172.21.15.119:0/2566835813 learned_addr learned my addr 172.21.15.119:0/2566835813 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:51.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc1400640 1 --2- 172.21.15.119:0/2566835813 >> v2:172.21.15.160:3300/0 conn(0x7f0bcc145b30 0x7f0bcc142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:51.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc9400640 1 -- 172.21.15.119:0/2566835813 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901444026 0 0) 0x7f0bcc06e0b0 con 0x7f0bcc0b4690 2024-03-08T21:34:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc9400640 1 -- 172.21.15.119:0/2566835813 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb0003530 con 0x7f0bcc0b4690 2024-03-08T21:34:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc1400640 1 -- 172.21.15.119:0/2566835813 >> v1:172.21.15.160:6789/0 conn(0x7f0bcc0b42b0 legacy=0x7f0bcc06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc1400640 1 -- 172.21.15.119:0/2566835813 >> v1:172.21.15.119:6789/0 conn(0x7f0bcc0b4690 legacy=0x7f0bcc14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc1400640 1 -- 172.21.15.119:0/2566835813 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc145330 con 0x7f0bcc145b30 2024-03-08T21:34:51.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc1400640 1 --2- 172.21.15.119:0/2566835813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc145b30 0x7f0bcc142380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc145820 tx=0x7f0bb401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffacdf495e3f0024 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:51.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.792+0000 7f0bc9400640 1 -- 172.21.15.119:0/2566835813 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40b0070 con 0x7f0bcc145b30 2024-03-08T21:34:51.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9400640 1 -- 172.21.15.119:0/2566835813 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb40ab600 con 0x7f0bcc145b30 2024-03-08T21:34:51.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9400640 1 -- 172.21.15.119:0/2566835813 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40ab9b0 con 0x7f0bcc145b30 2024-03-08T21:34:51.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- 172.21.15.119:0/2566835813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc145b30 msgr2=0x7f0bcc142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 --2- 172.21.15.119:0/2566835813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc145b30 0x7f0bcc142380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc145820 tx=0x7f0bb401c410 comp rx=0 tx=0).stop 2024-03-08T21:34:51.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- 172.21.15.119:0/2566835813 shutdown_connections 2024-03-08T21:34:51.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 --2- 172.21.15.119:0/2566835813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc145b30 0x7f0bcc142380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- 172.21.15.119:0/2566835813 >> 172.21.15.119:0/2566835813 conn(0x7f0bcc09a230 msgr2=0x7f0bcc09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:51.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- 172.21.15.119:0/2566835813 shutdown_connections 2024-03-08T21:34:51.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- 172.21.15.119:0/2566835813 wait complete. 2024-03-08T21:34:51.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 Processor -- start 2024-03-08T21:34:51.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- start start 2024-03-08T21:34:51.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:51.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 0x7f0bcc13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:51.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bcc145b30 0x7f0bcc0adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc153830 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b3850 con 0x7f0bcc0b4690 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bd1200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1539b0 con 0x7f0bcc145b30 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41562/0 (socket says 172.21.15.119:41562) 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 -- 172.21.15.119:0/1986724211 learned_addr learned my addr 172.21.15.119:0/1986724211 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 -- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bcc145b30 msgr2=0x7f0bcc0adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc1400640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 0x7f0bcc13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bcc145b30 0x7f0bcc0adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 -- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 msgr2=0x7f0bcc13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 0x7f0bcc13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc9e00640 1 -- 172.21.15.119:0/1986724211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc137690 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.796+0000 7f0bc1400640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 0x7f0bcc13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:51.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc9e00640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c7c0 tx=0x7f0bbc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:51.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc016020 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc006d60 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc003bc0 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0ad4a0 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc1373b0 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0ad9c0 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f0bbc00a850 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 0x7f0ba8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0bbc085480 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc1400640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 0x7f0ba8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:51.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.800+0000 7f0bc1400640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 0x7f0ba8069b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40ad000 tx=0x7f0bb40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:51.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.804+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f0bcc0ad9c0 con 0x7f0bcc0b42b0 2024-03-08T21:34:51.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:51.964+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0bcc09da10 con 0x7f0bcc0b42b0 2024-03-08T21:34:52.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.624+0000 7f0bc2a00640 1 -- 172.21.15.119:0/1986724211 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0bbc020020 con 0x7f0bcc0b42b0 2024-03-08T21:34:52.613 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'cephfs_data' removed 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 msgr2=0x7f0ba8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 0x7f0ba8069b20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40ad000 tx=0x7f0bb40a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 msgr2=0x7f0bcc1e2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c7c0 tx=0x7f0bbc00cc80 comp rx=0 tx=0).stop 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 shutdown_connections 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f0ba8067660 0x7f0ba8069b20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bcc145b30 0x7f0bcc0adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bcc0b4690 0x7f0bcc13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 --2- 172.21.15.119:0/1986724211 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0b42b0 0x7f0bcc1e2e20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 >> 172.21.15.119:0/1986724211 conn(0x7f0bcc09a230 msgr2=0x7f0bcc0b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:52.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 shutdown_connections 2024-03-08T21:34:52.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.628+0000 7f0bd1200640 1 -- 172.21.15.119:0/1986724211 wait complete. 2024-03-08T21:34:52.641 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-08T21:34:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 Processor -- start 2024-03-08T21:34:52.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 -- start start 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79c0145b30 0x7f79c0142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c006e0b0 con 0x7f79c00b4690 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c0145050 con 0x7f79c00b42b0 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79c5e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c01456a0 con 0x7f79c0145b30 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79bf400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f79c00b4690 0x7f79c014f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42474/0 (socket says 172.21.15.119:42474) 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79bf400640 1 -- 172.21.15.119:0/2741206136 learned_addr learned my addr 172.21.15.119:0/2741206136 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.796+0000 7f79be000640 1 --2- 172.21.15.119:0/2741206136 >> v2:172.21.15.160:3300/0 conn(0x7f79c0145b30 0x7f79c0142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869846450 0 0) 0x7f79c006e0b0 con 0x7f79c00b4690 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a4003530 con 0x7f79c00b4690 2024-03-08T21:34:52.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725467547 0 0) 0x7f79c0145050 con 0x7f79c00b42b0 2024-03-08T21:34:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c006e0b0 con 0x7f79c00b42b0 2024-03-08T21:34:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79be000640 1 -- 172.21.15.119:0/2741206136 >> v1:172.21.15.160:6789/0 conn(0x7f79c00b42b0 legacy=0x7f79c006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79be000640 1 -- 172.21.15.119:0/2741206136 >> v1:172.21.15.119:6789/0 conn(0x7f79c00b4690 legacy=0x7f79c014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2898642023 0 0) 0x7f79a4003530 con 0x7f79c00b4690 2024-03-08T21:34:52.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79be000640 1 -- 172.21.15.119:0/2741206136 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0145330 con 0x7f79c0145b30 2024-03-08T21:34:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79be000640 1 --2- 172.21.15.119:0/2741206136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c0142380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79c0145820 tx=0x7f79ac01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2988ebe3130be5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0b0070 con 0x7f79c0145b30 2024-03-08T21:34:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0ab400 con 0x7f79c0145b30 2024-03-08T21:34:52.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.800+0000 7f79bd600640 1 -- 172.21.15.119:0/2741206136 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8001a00 con 0x7f79c0145b30 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/2741206136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 msgr2=0x7f79c0142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 --2- 172.21.15.119:0/2741206136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c0142380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79c0145820 tx=0x7f79ac01c330 comp rx=0 tx=0).stop 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/2741206136 shutdown_connections 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 --2- 172.21.15.119:0/2741206136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c0142380 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/2741206136 >> 172.21.15.119:0/2741206136 conn(0x7f79c009a230 msgr2=0x7f79c009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/2741206136 shutdown_connections 2024-03-08T21:34:52.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/2741206136 wait complete. 2024-03-08T21:34:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 Processor -- start 2024-03-08T21:34:52.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- start start 2024-03-08T21:34:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79c00b4690 0x7f79c00ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c00aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:52.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0153830 con 0x7f79c00b42b0 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00b3850 con 0x7f79c0145b30 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01539b0 con 0x7f79c00b4690 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60372/0 (socket says 172.21.15.119:60372) 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 -- 172.21.15.119:0/3274131672 learned_addr learned my addr 172.21.15.119:0/3274131672 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bf400640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c00aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:52.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79be000640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79c00b4690 0x7f79c00ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 -- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79c00b4690 msgr2=0x7f79c00ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79c00b4690 0x7f79c00ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 -- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 msgr2=0x7f79c00aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c00aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 -- 172.21.15.119:0/3274131672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b0970 con 0x7f79c00b42b0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79bea00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c490 tx=0x7f79b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00052d0 con 0x7f79c00b42b0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0005470 con 0x7f79c00b42b0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0012870 con 0x7f79c00b42b0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c00b0c50 con 0x7f79c00b42b0 2024-03-08T21:34:52.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.804+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c00b0680 con 0x7f79c00b42b0 2024-03-08T21:34:52.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c00ad500 con 0x7f79c00b42b0 2024-03-08T21:34:52.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f79b0012a10 con 0x7f79c00b42b0 2024-03-08T21:34:52.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79b7400640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 0x7f79a0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:52.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f79b00850d0 con 0x7f79c00b42b0 2024-03-08T21:34:52.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79be000640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 0x7f79a0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:52.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.808+0000 7f79be000640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 0x7f79a0069b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ad000 tx=0x7f79ac0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:52.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.812+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f79b00559f0 con 0x7f79c00b42b0 2024-03-08T21:34:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.968+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f79c0067db0 con 0x7f79c00b42b0 2024-03-08T21:34:52.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.972+0000 7f79b7400640 1 -- 172.21.15.119:0/3274131672 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79b0059a90 con 0x7f79c00b42b0 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 msgr2=0x7f79a0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 0x7f79a0069b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ad000 tx=0x7f79ac0a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 msgr2=0x7f79c00b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f79b000c490 tx=0x7f79b000c950 comp rx=0 tx=0).stop 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 shutdown_connections 2024-03-08T21:34:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79a0067660 0x7f79a0069b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c0145b30 0x7f79c00aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79c00b4690 0x7f79c00ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 --2- 172.21.15.119:0/3274131672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79c00b42b0 0x7f79c00b0140 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 >> 172.21.15.119:0/3274131672 conn(0x7f79c009a230 msgr2=0x7f79c0150450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 shutdown_connections 2024-03-08T21:34:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:52.976+0000 7f79c5e00640 1 -- 172.21.15.119:0/3274131672 wait complete. 2024-03-08T21:34:52.991 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-03-08T21:34:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 Processor -- start 2024-03-08T21:34:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 -- start start 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f211809a8d0 0x7f211809ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211809a080 con 0x7f21180b1d30 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180b4510 con 0x7f2118099ca0 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211f600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180b4b60 con 0x7f211809a8d0 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f211809a8d0 0x7f211809ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f211809a8d0 0x7f211809ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60376/0 (socket says 172.21.15.119:60376) 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 -- 172.21.15.119:0/554633597 learned_addr learned my addr 172.21.15.119:0/554633597 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f211d600640 1 --1- 172.21.15.119:0/554633597 >> v1:172.21.15.119:6789/0 conn(0x7f21180b1d30 0x7f21180b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42486/0 (socket says 172.21.15.119:42486) 2024-03-08T21:34:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 -- 172.21.15.119:0/554633597 >> v1:172.21.15.160:6789/0 conn(0x7f2118099ca0 legacy=0x7f211813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 -- 172.21.15.119:0/554633597 >> v1:172.21.15.119:6789/0 conn(0x7f21180b1d30 legacy=0x7f21180b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.136+0000 7f2117e00640 1 -- 172.21.15.119:0/554633597 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180b47f0 con 0x7f211809a8d0 2024-03-08T21:34:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f2117e00640 1 --2- 172.21.15.119:0/554633597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f211809a8d0 0x7f211809ad40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2104009870 tx=0x7f210401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4b0d5d7f8c7b11 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f2117400640 1 -- 172.21.15.119:0/554633597 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ab430 con 0x7f211809a8d0 2024-03-08T21:34:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f2117400640 1 -- 172.21.15.119:0/554633597 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040b0070 con 0x7f211809a8d0 2024-03-08T21:34:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f2117400640 1 -- 172.21.15.119:0/554633597 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ab7f0 con 0x7f211809a8d0 2024-03-08T21:34:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 -- 172.21.15.119:0/554633597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f211809a8d0 msgr2=0x7f211809ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 --2- 172.21.15.119:0/554633597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f211809a8d0 0x7f211809ad40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2104009870 tx=0x7f210401c520 comp rx=0 tx=0).stop 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 -- 172.21.15.119:0/554633597 shutdown_connections 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 --2- 172.21.15.119:0/554633597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f211809a8d0 0x7f211809ad40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 -- 172.21.15.119:0/554633597 >> 172.21.15.119:0/554633597 conn(0x7f211806c620 msgr2=0x7f211806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 -- 172.21.15.119:0/554633597 shutdown_connections 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.140+0000 7f211f600640 1 -- 172.21.15.119:0/554633597 wait complete. 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 Processor -- start 2024-03-08T21:34:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- start start 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 0x7f2118071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21180b1d30 0x7f211813b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21181532e0 con 0x7f2118099ca0 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118153160 con 0x7f211809a8d0 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118153460 con 0x7f21180b1d30 2024-03-08T21:34:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60380/0 (socket says 172.21.15.119:60380) 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 -- 172.21.15.119:0/695119631 learned_addr learned my addr 172.21.15.119:0/695119631 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f2117e00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 0x7f2118071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 -- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21180b1d30 msgr2=0x7f211813b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21180b1d30 0x7f211813b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 -- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 msgr2=0x7f2118071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 0x7f2118071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 -- 172.21.15.119:0/695119631 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180b2600 con 0x7f2118099ca0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f2117e00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 0x7f2118071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211cc00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f210800ba50 tx=0x7f210800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108019070 con 0x7f2118099ca0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800cc10 con 0x7f2118099ca0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108014440 con 0x7f2118099ca0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21180725d0 con 0x7f2118099ca0 2024-03-08T21:34:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211806fa40 con 0x7f2118099ca0 2024-03-08T21:34:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.144+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118067db0 con 0x7f2118099ca0 2024-03-08T21:34:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.148+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f210801c070 con 0x7f2118099ca0 2024-03-08T21:34:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.148+0000 7f2114c00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 0x7f20f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.148+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f21080853f0 con 0x7f2118099ca0 2024-03-08T21:34:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.148+0000 7f2117e00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 0x7f20f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.148+0000 7f2117e00640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 0x7f20f8069b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21040af000 tx=0x7f2104008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:53.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.152+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f2108056360 con 0x7f2118099ca0 2024-03-08T21:34:53.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.360+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) v1 -- 0x7f21180b3920 con 0x7f2118099ca0 2024-03-08T21:34:53.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.624+0000 7f2114c00640 1 -- 172.21.15.119:0/695119631 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v85) v1 ==== 134+0+0 (secure 0 0 0) 0x7f2108055c60 con 0x7f2118099ca0 2024-03-08T21:34:53.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 msgr2=0x7f20f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 0x7f20f8069b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21040af000 tx=0x7f2104008040 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 msgr2=0x7f2118070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f210800ba50 tx=0x7f210800bf10 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 shutdown_connections 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f20f8067660 0x7f20f8069b20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21180b1d30 0x7f211813b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211809a8d0 0x7f2118071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 --2- 172.21.15.119:0/695119631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2118099ca0 0x7f2118070c00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 >> 172.21.15.119:0/695119631 conn(0x7f211806c620 msgr2=0x7f21180b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 shutdown_connections 2024-03-08T21:34:53.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:53.628+0000 7f211f600640 1 -- 172.21.15.119:0/695119631 wait complete. 2024-03-08T21:34:53.639 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-03-08T21:34:53.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: r.wait() 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 127: 'cephfs-shell -b /tmp/test-cephfsuv9endif' 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:Ran 1 test in 43.129s 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner: 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-08T21:34:53.641 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: r.wait() 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-03-08T21:34:53.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-03-08T21:34:53.643 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-03-08T21:34:53.643 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 127: 'cephfs-shell -b /tmp/test-cephfsuv9endif' 2024-03-08T21:34:53.643 INFO:tasks.cephfs_test_runner: 2024-03-08T21:34:53.643 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-03-08T21:34:53.877 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=860856364f0c489fb84fc84e6b2643da Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-03-08T21:34:53.879 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-08T21:34:53.889 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-08T21:34:53.907 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-08T21:34:53.907 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-03-08T21:34:53.907 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T21:34:53.921 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354564k,nr_inodes=4088641,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7572 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275364k,nr_inodes=818841,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275368k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-03-08T21:34:53.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:53.921 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2024-03-08T21:34:53.972 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T21:34:53.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:53.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T21:34:54.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T21:34:54.038 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2024-03-08T21:34:54.230 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-08T21:34:54.380 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T21:34:54.380 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:54.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.528+0000 7f35aa800640 1 Processor -- start 2024-03-08T21:34:54.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 -- start start 2024-03-08T21:34:54.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 0x7f35a40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35a413f2b0 0x7f35a40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40b2be0 con 0x7f35a40b47f0 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40b5970 con 0x7f35a413f2b0 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35aa800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40b5fb0 con 0x7f35a40b4410 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35a413f2b0 0x7f35a40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35a413f2b0 0x7f35a40b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60382/0 (socket says 172.21.15.119:60382) 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 -- 172.21.15.119:0/3433427060 learned_addr learned my addr 172.21.15.119:0/3433427060 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3400640 1 --2- 172.21.15.119:0/3433427060 >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 0x7f35a40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 -- 172.21.15.119:0/3433427060 >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 msgr2=0x7f35a40b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:54.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 --2- 172.21.15.119:0/3433427060 >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 0x7f35a40b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 -- 172.21.15.119:0/3433427060 >> v1:172.21.15.160:6789/0 conn(0x7f35a40b47f0 legacy=0x7f35a413eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:54.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3e00640 1 -- 172.21.15.119:0/3433427060 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40b5600 con 0x7f35a413f2b0 2024-03-08T21:34:54.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.532+0000 7f35a3400640 1 --2- 172.21.15.119:0/3433427060 >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 0x7f35a40b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:54.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35a3e00640 1 --2- 172.21.15.119:0/3433427060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a413f2b0 0x7f35a40b3820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f35a40732a0 tx=0x7f359c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf6e81ab825482b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35a2a00640 1 -- 172.21.15.119:0/3433427060 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0b0070 con 0x7f35a413f2b0 2024-03-08T21:34:54.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35a2a00640 1 -- 172.21.15.119:0/3433427060 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c0ab600 con 0x7f35a413f2b0 2024-03-08T21:34:54.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35a2a00640 1 -- 172.21.15.119:0/3433427060 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c0ab9d0 con 0x7f35a413f2b0 2024-03-08T21:34:54.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- 172.21.15.119:0/3433427060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a413f2b0 msgr2=0x7f35a40b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 --2- 172.21.15.119:0/3433427060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a413f2b0 0x7f35a40b3820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f35a40732a0 tx=0x7f359c01c4e0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- 172.21.15.119:0/3433427060 shutdown_connections 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 --2- 172.21.15.119:0/3433427060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a413f2b0 0x7f35a40b3820 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 --2- 172.21.15.119:0/3433427060 >> v2:172.21.15.160:3300/0 conn(0x7f35a40b4410 0x7f35a40b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- 172.21.15.119:0/3433427060 >> 172.21.15.119:0/3433427060 conn(0x7f35a406b6e0 msgr2=0x7f35a40ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- 172.21.15.119:0/3433427060 shutdown_connections 2024-03-08T21:34:54.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- 172.21.15.119:0/3433427060 wait complete. 2024-03-08T21:34:54.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 Processor -- start 2024-03-08T21:34:54.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.536+0000 7f35aa800640 1 -- start start 2024-03-08T21:34:54.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35a40b47f0 0x7f35a41e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35a413f2b0 0x7f35a413f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4152080 con 0x7f35a40b4410 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4152200 con 0x7f35a40b47f0 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4152380 con 0x7f35a413f2b0 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60392/0 (socket says 172.21.15.119:60392) 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 -- 172.21.15.119:0/1321150041 learned_addr learned my addr 172.21.15.119:0/1321150041 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359aa00640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35a40b47f0 0x7f35a41e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3e00640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35a413f2b0 0x7f35a413f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 -- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35a413f2b0 msgr2=0x7f35a413f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35a413f2b0 0x7f35a413f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 -- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35a40b47f0 msgr2=0x7f35a41e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35a40b47f0 0x7f35a41e2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 -- 172.21.15.119:0/1321150041 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40ad9a0 con 0x7f35a40b4410 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35a3400640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f359400cf60 tx=0x7f359400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359401a070 con 0x7f35a40b4410 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400d840 con 0x7f35a40b4410 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a40ac960 con 0x7f35a40b4410 2024-03-08T21:34:54.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400dc10 con 0x7f35a40b4410 2024-03-08T21:34:54.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4141430 con 0x7f35a40b4410 2024-03-08T21:34:54.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a4067db0 con 0x7f35a40b4410 2024-03-08T21:34:54.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f359401d070 con 0x7f35a40b4410 2024-03-08T21:34:54.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.540+0000 7f359be00640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 0x7f3580069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.544+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3594085d90 con 0x7f35a40b4410 2024-03-08T21:34:54.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.544+0000 7f359aa00640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 0x7f3580069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.544+0000 7f359aa00640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 0x7f3580069b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35a40b0940 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.548+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f35940566b0 con 0x7f35a40b4410 2024-03-08T21:34:54.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.704+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35a4143a50 con 0x7f3580067690 2024-03-08T21:34:54.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.704+0000 7f359be00640 1 -- 172.21.15.119:0/1321150041 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13422 (secure 0 0 0) 0x7f35a4143a50 con 0x7f3580067690 2024-03-08T21:34:54.696 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:54.696 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:54.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 msgr2=0x7f3580069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 0x7f3580069b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35a40b0940 tx=0x7f358c009040 comp rx=0 tx=0).stop 2024-03-08T21:34:54.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 msgr2=0x7f35a406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f359400cf60 tx=0x7f359400cf90 comp rx=0 tx=0).stop 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 shutdown_connections 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3580067690 0x7f3580069b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35a413f2b0 0x7f35a413f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35a40b47f0 0x7f35a41e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 --2- 172.21.15.119:0/1321150041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35a40b4410 0x7f35a406d140 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 >> 172.21.15.119:0/1321150041 conn(0x7f35a406b6e0 msgr2=0x7f35a40b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 shutdown_connections 2024-03-08T21:34:54.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.708+0000 7f35aa800640 1 -- 172.21.15.119:0/1321150041 wait complete. 2024-03-08T21:34:54.716 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-03-08T21:34:54.428005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3936256,"data_stored":2231255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000928"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-08T21:34:49.462058+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:49.462058+0000","last_peered":"2024-03-08T21:34:49.462058+0000","last_clean":"2024-03-08T21:34:49.462058+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:49.462058+0000","last_undegraded":"2024-03-08T21:34:49.462058+0000","last_fullsized":"2024-03-08T21:34:49.462058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":721804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":125881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":125937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":125369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":921600,"data_stored":715633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:54.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:54.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.860+0000 7f13c7200640 1 Processor -- start 2024-03-08T21:34:54.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.860+0000 7f13c7200640 1 -- start start 2024-03-08T21:34:54.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.860+0000 7f13c7200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13c009adb0 0x7f13c009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13c7200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c013d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13c7200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c009b190 con 0x7f13c0072fe0 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13c7200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c009d240 con 0x7f13c009adb0 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13c7200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009d520 con 0x7f13c01448b0 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13c009adb0 0x7f13c009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13c5200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c013d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f13c009adb0 0x7f13c009cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:60794/0 (socket says 172.21.15.119:60794) 2024-03-08T21:34:54.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 -- 172.21.15.119:0/657763171 learned_addr learned my addr 172.21.15.119:0/657763171 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:54.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 -- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 msgr2=0x7f13c013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:54.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 --2- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c013d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 -- 172.21.15.119:0/657763171 >> v1:172.21.15.160:6789/0 conn(0x7f13c0072fe0 legacy=0x7f13c01441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 -- 172.21.15.119:0/657763171 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0143c50 con 0x7f13c009adb0 2024-03-08T21:34:54.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.864+0000 7f13bfe00640 1 --2- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c009adb0 0x7f13c009cbf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009e50 tx=0x7f13b001ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad9212d5ebf4370 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13bf400640 1 -- 172.21.15.119:0/657763171 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00a79d0 con 0x7f13c009adb0 2024-03-08T21:34:54.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13bf400640 1 -- 172.21.15.119:0/657763171 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00a7b70 con 0x7f13c009adb0 2024-03-08T21:34:54.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13bf400640 1 -- 172.21.15.119:0/657763171 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00af3f0 con 0x7f13c009adb0 2024-03-08T21:34:54.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c009adb0 msgr2=0x7f13c009cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c009adb0 0x7f13c009cbf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009e50 tx=0x7f13b001ec40 comp rx=0 tx=0).stop 2024-03-08T21:34:54.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- 172.21.15.119:0/657763171 shutdown_connections 2024-03-08T21:34:54.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c013d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- 172.21.15.119:0/657763171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c009adb0 0x7f13c009cbf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- 172.21.15.119:0/657763171 >> 172.21.15.119:0/657763171 conn(0x7f13c006c620 msgr2=0x7f13c006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:54.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- 172.21.15.119:0/657763171 shutdown_connections 2024-03-08T21:34:54.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- 172.21.15.119:0/657763171 wait complete. 2024-03-08T21:34:54.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 Processor -- start 2024-03-08T21:34:54.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- start start 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 0x7f13c00b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c01e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009a5e0 con 0x7f13c009adb0 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009a460 con 0x7f13c0072fe0 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c7200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009a760 con 0x7f13c01448b0 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13b7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 0x7f13c00b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13b7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60404/0 (socket says 172.21.15.119:60404) 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13b7400640 1 -- 172.21.15.119:0/371530200 learned_addr learned my addr 172.21.15.119:0/371530200 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13c5200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c01e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13b7400640 1 -- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 msgr2=0x7f13c01e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.868+0000 7f13b7400640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c01e0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13b7400640 1 -- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 msgr2=0x7f13c00b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13b7400640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 0x7f13c00b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:54.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13b7400640 1 -- 172.21.15.119:0/371530200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00b29d0 con 0x7f13c009adb0 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bfe00640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 0x7f13c00b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13b7400640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13a800c430 tx=0x7f13a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80052d0 con 0x7f13c009adb0 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a8005470 con 0x7f13c009adb0 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c00b0ee0 con 0x7f13c009adb0 2024-03-08T21:34:54.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8007260 con 0x7f13c009adb0 2024-03-08T21:34:54.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c00b14a0 con 0x7f13c009adb0 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c00afdf0 con 0x7f13c009adb0 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f13a8007400 con 0x7f13c009adb0 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 0x7f139c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f13a8084a10 con 0x7f13c009adb0 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.872+0000 7f13bfe00640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 0x7f139c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:54.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.876+0000 7f13bfe00640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 0x7f139c069b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13b00b0000 tx=0x7f13b000d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:54.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:54.876+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f13a8055330 con 0x7f13c009adb0 2024-03-08T21:34:55.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.028+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c00b1670 con 0x7f139c067660 2024-03-08T21:34:55.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.028+0000 7f13bcc00640 1 -- 172.21.15.119:0/371530200 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13422 (secure 0 0 0) 0x7f13c00b1670 con 0x7f139c067660 2024-03-08T21:34:55.020 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:55.020 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:55.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 msgr2=0x7f139c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 0x7f139c069b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13b00b0000 tx=0x7f13b000d040 comp rx=0 tx=0).stop 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 msgr2=0x7f13c00b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13a800c430 tx=0x7f13a800c8f0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 shutdown_connections 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f139c067660 0x7f139c069b20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f13c01448b0 0x7f13c01e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13c009adb0 0x7f13c00b2330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 --2- 172.21.15.119:0/371530200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13c0072fe0 0x7f13c00b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 >> 172.21.15.119:0/371530200 conn(0x7f13c006c620 msgr2=0x7f13c0073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:55.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 shutdown_connections 2024-03-08T21:34:55.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.032+0000 7f13c7200640 1 -- 172.21.15.119:0/371530200 wait complete. 2024-03-08T21:34:55.039 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-03-08T21:34:54.428005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3936256,"data_stored":2231255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000928"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-08T21:34:49.462058+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:49.462058+0000","last_peered":"2024-03-08T21:34:49.462058+0000","last_clean":"2024-03-08T21:34:49.462058+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:49.462058+0000","last_undegraded":"2024-03-08T21:34:49.462058+0000","last_fullsized":"2024-03-08T21:34:49.462058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":721804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":125881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":125937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":125369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":921600,"data_stored":715633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:55.040 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T21:34:55.040 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:34:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 Processor -- start 2024-03-08T21:34:55.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 -- start start 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f984c09adb0 0x7f984c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f984c1448b0 0x7f984c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c09b190 con 0x7f984c072fe0 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c09d240 con 0x7f984c09adb0 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9854400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c09d520 con 0x7f984c1448b0 2024-03-08T21:34:55.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f984c09adb0 0x7f984c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f984c072fe0 0x7f984c1441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42498/0 (socket says 172.21.15.119:42498) 2024-03-08T21:34:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851000640 1 -- 172.21.15.119:0/2543438507 learned_addr learned my addr 172.21.15.119:0/2543438507 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f984c09adb0 0x7f984c09cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60420/0 (socket says 172.21.15.119:60420) 2024-03-08T21:34:55.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9852400640 1 --2- 172.21.15.119:0/2543438507 >> v2:172.21.15.160:3300/0 conn(0x7f984c1448b0 0x7f984c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 -- 172.21.15.119:0/2543438507 >> v2:172.21.15.160:3300/0 conn(0x7f984c1448b0 msgr2=0x7f984c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 --2- 172.21.15.119:0/2543438507 >> v2:172.21.15.160:3300/0 conn(0x7f984c1448b0 0x7f984c13d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 -- 172.21.15.119:0/2543438507 >> v1:172.21.15.119:6789/0 conn(0x7f984c072fe0 legacy=0x7f984c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f9851a00640 1 -- 172.21.15.119:0/2543438507 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c143c50 con 0x7f984c09adb0 2024-03-08T21:34:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.184+0000 7f984be00640 1 -- 172.21.15.119:0/2543438507 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335340504 0 0) 0x7f984c09b190 con 0x7f984c072fe0 2024-03-08T21:34:55.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9851a00640 1 --2- 172.21.15.119:0/2543438507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c09adb0 0x7f984c09cbf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f984c09d130 tx=0x7f984001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d29424dcadc59f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f984be00640 1 -- 172.21.15.119:0/2543438507 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400b4070 con 0x7f984c09adb0 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f984be00640 1 -- 172.21.15.119:0/2543438507 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400a7ae0 con 0x7f984c09adb0 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f984be00640 1 -- 172.21.15.119:0/2543438507 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400af440 con 0x7f984c09adb0 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 -- 172.21.15.119:0/2543438507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c09adb0 msgr2=0x7f984c09cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 --2- 172.21.15.119:0/2543438507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c09adb0 0x7f984c09cbf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f984c09d130 tx=0x7f984001eb50 comp rx=0 tx=0).stop 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 -- 172.21.15.119:0/2543438507 shutdown_connections 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 --2- 172.21.15.119:0/2543438507 >> v2:172.21.15.160:3300/0 conn(0x7f984c1448b0 0x7f984c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 --2- 172.21.15.119:0/2543438507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c09adb0 0x7f984c09cbf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 -- 172.21.15.119:0/2543438507 >> 172.21.15.119:0/2543438507 conn(0x7f984c06c620 msgr2=0x7f984c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 -- 172.21.15.119:0/2543438507 shutdown_connections 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.188+0000 7f9854400640 1 -- 172.21.15.119:0/2543438507 wait complete. 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 Processor -- start 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- start start 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 0x7f984c135250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f984c1448b0 0x7f984c135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c09a5e0 con 0x7f984c072fe0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c09a460 con 0x7f984c09adb0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c09a760 con 0x7f984c1448b0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60432/0 (socket says 172.21.15.119:60432) 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 -- 172.21.15.119:0/2166673680 learned_addr learned my addr 172.21.15.119:0/2166673680 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9852400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f984c1448b0 0x7f984c135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851000640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 0x7f984c135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 -- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f984c1448b0 msgr2=0x7f984c135790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f984c1448b0 0x7f984c135790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 -- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 msgr2=0x7f984c135250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 0x7f984c135250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 -- 172.21.15.119:0/2166673680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c070b30 con 0x7f984c072fe0 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851000640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 0x7f984c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9851a00640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f984001b760 tx=0x7f984001b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400b4040 con 0x7f984c072fe0 2024-03-08T21:34:55.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400bd070 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400afe40 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c070e10 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.192+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c0b6c30 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c067db0 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f98400c2460 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9849600640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 0x7f982c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f984011ffd0 con 0x7f984c072fe0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9851000640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 0x7f982c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.196+0000 7f9851000640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 0x7f982c069b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9838007fd0 tx=0x7f9838009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.200+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f9840018740 con 0x7f984c072fe0 2024-03-08T21:34:55.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.352+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f984c144690 con 0x7f982c067660 2024-03-08T21:34:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.352+0000 7f9849600640 1 -- 172.21.15.119:0/2166673680 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13422 (secure 0 0 0) 0x7f984c144690 con 0x7f982c067660 2024-03-08T21:34:55.342 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:55.343 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:34:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 msgr2=0x7f982c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 0x7f982c069b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9838007fd0 tx=0x7f9838009040 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 msgr2=0x7f984c071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f984001b760 tx=0x7f984001b8f0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 shutdown_connections 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f982c067660 0x7f982c069b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f984c1448b0 0x7f984c135790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f984c09adb0 0x7f984c135250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 --2- 172.21.15.119:0/2166673680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f984c072fe0 0x7f984c071590 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 >> 172.21.15.119:0/2166673680 conn(0x7f984c06c620 msgr2=0x7f984c13bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:55.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 shutdown_connections 2024-03-08T21:34:55.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.356+0000 7f9854400640 1 -- 172.21.15.119:0/2166673680 wait complete. 2024-03-08T21:34:55.362 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-03-08T21:34:54.428005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224176,"kb_used_data":3844,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750544,"statfs":{"total":773094113280,"available":772864557056,"internally_reserved":0,"allocated":3936256,"data_stored":2231255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10734,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000928"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-08T21:34:49.462058+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:49.462058+0000","last_peered":"2024-03-08T21:34:49.462058+0000","last_clean":"2024-03-08T21:34:49.462058+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:49.462058+0000","last_undegraded":"2024-03-08T21:34:49.462058+0000","last_fullsized":"2024-03-08T21:34:49.462058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":721804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":125881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":125937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":125335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":145648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":125369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":921600,"data_stored":715633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:34:55.363 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T21:34:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 Processor -- start 2024-03-08T21:34:55.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 -- start start 2024-03-08T21:34:55.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a18099ca0 0x7f7a1813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1813f2c0 0x7f7a1809a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1809a080 con 0x7f7a1809ae10 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a180b4b60 con 0x7f7a18099ca0 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.508+0000 7f7a1f800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180b4510 con 0x7f7a1813f2c0 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1813f2c0 0x7f7a1809a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a18099ca0 0x7f7a1813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7a18099ca0 0x7f7a1813ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.119:60832/0 (socket says 172.21.15.119:60832) 2024-03-08T21:34:55.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1109690670 learned_addr learned my addr 172.21.15.119:0/1109690670 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1813f2c0 msgr2=0x7f7a1809a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 --2- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1813f2c0 0x7f7a1809a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1109690670 >> v1:172.21.15.160:6789/0 conn(0x7f7a1809ae10 legacy=0x7f7a180b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1109690670 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a180b47f0 con 0x7f7a18099ca0 2024-03-08T21:34:55.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.512+0000 7f7a1ce00640 1 --2- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18099ca0 0x7f7a1813ed80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009870 tx=0x7f7a0801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7094d3f1b37b9408 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a17e00640 1 -- 172.21.15.119:0/1109690670 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080a7070 con 0x7f7a18099ca0 2024-03-08T21:34:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a17e00640 1 -- 172.21.15.119:0/1109690670 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080b0070 con 0x7f7a18099ca0 2024-03-08T21:34:55.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a17e00640 1 -- 172.21.15.119:0/1109690670 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080ab890 con 0x7f7a18099ca0 2024-03-08T21:34:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18099ca0 msgr2=0x7f7a1813ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18099ca0 0x7f7a1813ed80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009870 tx=0x7f7a0801c520 comp rx=0 tx=0).stop 2024-03-08T21:34:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- 172.21.15.119:0/1109690670 shutdown_connections 2024-03-08T21:34:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1813f2c0 0x7f7a1809a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1109690670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18099ca0 0x7f7a1813ed80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- 172.21.15.119:0/1109690670 >> 172.21.15.119:0/1109690670 conn(0x7f7a1806c620 msgr2=0x7f7a1806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- 172.21.15.119:0/1109690670 shutdown_connections 2024-03-08T21:34:55.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- 172.21.15.119:0/1109690670 wait complete. 2024-03-08T21:34:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 Processor -- start 2024-03-08T21:34:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- start start 2024-03-08T21:34:55.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1809ae10 0x7f7a180b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1813f2c0 0x7f7a181dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18152150 con 0x7f7a18099ca0 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1809b220 con 0x7f7a1813f2c0 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1f800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181522d0 con 0x7f7a1809ae10 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60442/0 (socket says 172.21.15.119:60442) 2024-03-08T21:34:55.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1569728188 learned_addr learned my addr 172.21.15.119:0/1569728188 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a0fe00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1809ae10 0x7f7a180b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.516+0000 7f7a1d800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1813f2c0 0x7f7a181dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1809ae10 msgr2=0x7f7a180b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1809ae10 0x7f7a180b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1813f2c0 msgr2=0x7f7a181dfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1813f2c0 0x7f7a181dfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 -- 172.21.15.119:0/1569728188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a181e31b0 con 0x7f7a18099ca0 2024-03-08T21:34:55.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1ce00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ad040 tx=0x7f7a0801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080aa8e0 con 0x7f7a18099ca0 2024-03-08T21:34:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080aaaa0 con 0x7f7a18099ca0 2024-03-08T21:34:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1809d560 con 0x7f7a18099ca0 2024-03-08T21:34:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080aae90 con 0x7f7a18099ca0 2024-03-08T21:34:55.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a181e3700 con 0x7f7a18099ca0 2024-03-08T21:34:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a18067db0 con 0x7f7a18099ca0 2024-03-08T21:34:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f7a080b43f0 con 0x7f7a18099ca0 2024-03-08T21:34:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 0x7f79f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:55.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a0811ffd0 con 0x7f7a18099ca0 2024-03-08T21:34:55.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.520+0000 7f7a0fe00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 0x7f79f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:55.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.524+0000 7f7a0fe00640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 0x7f79f4069b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a18139920 tx=0x7f7a00009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:55.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.524+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f7a080c4060 con 0x7f7a18099ca0 2024-03-08T21:34:55.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.684+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a1813af30 con 0x7f7a18099ca0 2024-03-08T21:34:55.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a15600640 1 -- 172.21.15.119:0/1569728188 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+13046 (secure 0 0 0) 0x7f7a08016110 con 0x7f7a18099ca0 2024-03-08T21:34:55.677 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:34:55.677 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":33,"fsid":"b59e109d-7f9b-46a7-b423-bd44b3e2407a","created":"2024-03-08T21:33:23.369909+0000","modified":"2024-03-08T21:34:52.622848+0000","last_up_change":"2024-03-08T21:33:35.224359+0000","last_in_change":"2024-03-08T21:33:25.908447+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T21:33:34.472655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0fbf591f-25a6-4dde-b8a9-83ab24ab45bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6801","nonce":457875351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6803","nonce":457875351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6807","nonce":457875351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":457875351},{"type":"v1","addr":"172.21.15.119:6805","nonce":457875351}]},"public_addr":"172.21.15.119:6801/457875351","cluster_addr":"172.21.15.119:6803/457875351","heartbeat_back_addr":"172.21.15.119:6807/457875351","heartbeat_front_addr":"172.21.15.119:6805/457875351","state":["exists","up"]},{"osd":1,"uuid":"d76f7ee4-61f5-4e23-873f-40f4785e122c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6809","nonce":585002504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6811","nonce":585002504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6815","nonce":585002504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":585002504},{"type":"v1","addr":"172.21.15.119:6813","nonce":585002504}]},"public_addr":"172.21.15.119:6809/585002504","cluster_addr":"172.21.15.119:6811/585002504","heartbeat_back_addr":"172.21.15.119:6815/585002504","heartbeat_front_addr":"172.21.15.119:6813/585002504","state":["exists","up"]},{"osd":2,"uuid":"6fa49417-d2de-4f3a-be3c-0f49df1ef4ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6825","nonce":2768009528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6827","nonce":2768009528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6831","nonce":2768009528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2768009528},{"type":"v1","addr":"172.21.15.119:6829","nonce":2768009528}]},"public_addr":"172.21.15.119:6825/2768009528","cluster_addr":"172.21.15.119:6827/2768009528","heartbeat_back_addr":"172.21.15.119:6831/2768009528","heartbeat_front_addr":"172.21.15.119:6829/2768009528","state":["exists","up"]},{"osd":3,"uuid":"ab7243ce-9ded-4db5-9b08-8378e2558ad9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6817","nonce":937098264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6819","nonce":937098264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6823","nonce":937098264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":937098264},{"type":"v1","addr":"172.21.15.119:6821","nonce":937098264}]},"public_addr":"172.21.15.119:6817/937098264","cluster_addr":"172.21.15.119:6819/937098264","heartbeat_back_addr":"172.21.15.119:6823/937098264","heartbeat_front_addr":"172.21.15.119:6821/937098264","state":["exists","up"]},{"osd":4,"uuid":"c1da51bd-791e-44f5-b4d8-438af8a3e23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6801","nonce":1676941405}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6803","nonce":1676941405}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6807","nonce":1676941405}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1676941405},{"type":"v1","addr":"172.21.15.160:6805","nonce":1676941405}]},"public_addr":"172.21.15.160:6801/1676941405","cluster_addr":"172.21.15.160:6803/1676941405","heartbeat_back_addr":"172.21.15.160:6807/1676941405","heartbeat_front_addr":"172.21.15.160:6805/1676941405","state":["exists","up"]},{"osd":5,"uuid":"a5187b13-fff0-4398-b65d-32bfcbc374d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6817","nonce":3177605674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6819","nonce":3177605674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6823","nonce":3177605674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3177605674},{"type":"v1","addr":"172.21.15.160:6821","nonce":3177605674}]},"public_addr":"172.21.15.160:6817/3177605674","cluster_addr":"172.21.15.160:6819/3177605674","heartbeat_back_addr":"172.21.15.160:6823/3177605674","heartbeat_front_addr":"172.21.15.160:6821/3177605674","state":["exists","up"]},{"osd":6,"uuid":"be79ccf5-b97f-4367-bbb6-2b44e4753d34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6825","nonce":2462175977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6827","nonce":2462175977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6831","nonce":2462175977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":2462175977},{"type":"v1","addr":"172.21.15.160:6829","nonce":2462175977}]},"public_addr":"172.21.15.160:6825/2462175977","cluster_addr":"172.21.15.160:6827/2462175977","heartbeat_back_addr":"172.21.15.160:6831/2462175977","heartbeat_front_addr":"172.21.15.160:6829/2462175977","state":["exists","up"]},{"osd":7,"uuid":"86c4b4dd-25d5-4811-b5fd-4e105b5bc1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6809","nonce":1919516380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6811","nonce":1919516380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6815","nonce":1919516380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1919516380},{"type":"v1","addr":"172.21.15.160:6813","nonce":1919516380}]},"public_addr":"172.21.15.160:6809/1919516380","cluster_addr":"172.21.15.160:6811/1919516380","heartbeat_back_addr":"172.21.15.160:6815/1919516380","heartbeat_front_addr":"172.21.15.160:6813/1919516380","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.387627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.598962+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.685226+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.525142+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:32.539029+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.560717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.677208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T21:33:31.520824+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6835/3038640532":"2024-03-09T21:34:49.455869+0000","172.21.15.119:6834/3038640532":"2024-03-09T21:34:49.455869+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 msgr2=0x7f79f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 0x7f79f4069b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a18139920 tx=0x7f7a00009190 comp rx=0 tx=0).stop 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 msgr2=0x7f7a181e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ad040 tx=0x7f7a0801ad60 comp rx=0 tx=0).stop 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 shutdown_connections 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f79f4067660 0x7f79f4069b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a1813f2c0 0x7f7a181dfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7a1809ae10 0x7f7a180b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 --2- 172.21.15.119:0/1569728188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a18099ca0 0x7f7a181e3c20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:55.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 >> 172.21.15.119:0/1569728188 conn(0x7f7a1806c620 msgr2=0x7f7a18138a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:55.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 shutdown_connections 2024-03-08T21:34:55.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:55.688+0000 7f7a1f800640 1 -- 172.21.15.119:0/1569728188 wait complete. 2024-03-08T21:34:56.698 INFO:tasks.ceph:Scrubbing osd.0 2024-03-08T21:34:56.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:56.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 Processor -- start 2024-03-08T21:34:56.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 -- start start 2024-03-08T21:34:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f903c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c06cc20 con 0x7f903c140fb0 2024-03-08T21:34:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0b3670 con 0x7f903c144030 2024-03-08T21:34:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9044400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3950 con 0x7f903c06c840 2024-03-08T21:34:56.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9042400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f903c140fb0 0x7f903c141420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42514/0 (socket says 172.21.15.119:42514) 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9042400640 1 -- 172.21.15.119:0/1009087651 learned_addr learned my addr 172.21.15.119:0/1009087651 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.856+0000 7f9041a00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f903c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359451048 0 0) 0x7f903c06cc20 con 0x7f903c140fb0 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9024003530 con 0x7f903c140fb0 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042643900 0 0) 0x7f9024003530 con 0x7f903c140fb0 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 msgr2=0x7f903c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f903c0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 >> v1:172.21.15.160:6789/0 conn(0x7f903c144030 legacy=0x7f903c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0b3c30 con 0x7f903c140fb0 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 723158737 0 0) 0x7f9034001a00 con 0x7f903c140fb0 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 >> v1:172.21.15.119:6789/0 conn(0x7f903c140fb0 legacy=0x7f903c141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f90240039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9024003fc0 0x7f9024004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024004d50 0x7f90240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3950 con 0x7f9024003fc0 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902400bbc0 con 0x7f9024004d50 2024-03-08T21:34:56.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902400dfd0 con 0x7f903c06c840 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9024003fc0 0x7f9024004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041a00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f90240039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9042400640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024004d50 0x7f90240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 -- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 msgr2=0x7f90240039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f90240039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 -- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024004d50 msgr2=0x7f90240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024004d50 0x7f90240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041000640 1 -- 172.21.15.119:0/1009087651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024003530 con 0x7f9024003fc0 2024-03-08T21:34:56.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.860+0000 7f9041a00640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c06c840 0x7f90240039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9041000640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9024003fc0 0x7f9024004810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9028001750 tx=0x7f902801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4b8b4ca2312c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280013a0 con 0x7f9024003fc0 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90280052f0 con 0x7f9024003fc0 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f903be00640 1 -- 172.21.15.119:0/1009087651 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9028003840 con 0x7f9024003fc0 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- 172.21.15.119:0/1009087651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9024003fc0 msgr2=0x7f9024004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 --2- 172.21.15.119:0/1009087651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9024003fc0 0x7f9024004810 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9028001750 tx=0x7f902801c3e0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9042400640 1 -- 172.21.15.119:0/1009087651 reap_dead start 2024-03-08T21:34:56.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- 172.21.15.119:0/1009087651 shutdown_connections 2024-03-08T21:34:56.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- 172.21.15.119:0/1009087651 >> 172.21.15.119:0/1009087651 conn(0x7f903c09a230 msgr2=0x7f903c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:56.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- 172.21.15.119:0/1009087651 shutdown_connections 2024-03-08T21:34:56.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- 172.21.15.119:0/1009087651 wait complete. 2024-03-08T21:34:56.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 Processor -- start 2024-03-08T21:34:56.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- start start 2024-03-08T21:34:56.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024003fc0 0x7f903c147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c13c990 0x7f903c13b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 0x7f903c099490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c06da90 con 0x7f903c13be40 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c06d910 con 0x7f9024003fc0 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9044400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c06dc10 con 0x7f903c13c990 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9042400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 0x7f903c099490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9042400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 0x7f903c099490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60468/0 (socket says 172.21.15.119:60468) 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.864+0000 7f9042400640 1 -- 172.21.15.119:0/264682326 learned_addr learned my addr 172.21.15.119:0/264682326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9041000640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c13c990 0x7f903c13b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9041a00640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024003fc0 0x7f903c147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 -- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c13c990 msgr2=0x7f903c13b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f903c13c990 0x7f903c13b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 -- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024003fc0 msgr2=0x7f903c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9024003fc0 0x7f903c147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c13c2c0 con 0x7f903c13be40 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9042400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 0x7f903c099490 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f903c073540 tx=0x7f9034007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300096b0 con 0x7f903c13be40 2024-03-08T21:34:56.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034016650 con 0x7f903c13be40 2024-03-08T21:34:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034016a40 con 0x7f903c13be40 2024-03-08T21:34:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c070cf0 con 0x7f903c13be40 2024-03-08T21:34:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c06fdf0 con 0x7f903c13be40 2024-03-08T21:34:56.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f903c067db0 con 0x7f903c13be40 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f9034016be0 con 0x7f903c13be40 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f901c067660 0x7f901c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9034089860 con 0x7f903c13be40 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9041a00640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f901c067660 0x7f901c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7f901c06d520 0x7f901c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f901c06fff0 con 0x7f901c06d520 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.868+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f903408e2c0 con 0x7f903c13be40 2024-03-08T21:34:56.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.872+0000 7f9041000640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7f901c06d520 0x7f901c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:56.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.872+0000 7f9041a00640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f901c067660 0x7f901c069b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9030009c40 tx=0x7f9030008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:56.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.872+0000 7f9041000640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7f901c06d520 0x7f901c06f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:56.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.872+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== osd.0 v2:172.21.15.119:6800/457875351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f901c06fff0 con 0x7f901c06d520 2024-03-08T21:34:56.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 --> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f903c0686c0 con 0x7f901c06d520 2024-03-08T21:34:56.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9039600640 1 -- 172.21.15.119:0/264682326 <== osd.0 v2:172.21.15.119:6800/457875351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f903c0686c0 con 0x7f901c06d520 2024-03-08T21:34:56.874 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:56.875 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:56.875 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7f901c06d520 msgr2=0x7f901c06f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6800/457875351,v1:172.21.15.119:6801/457875351] conn(0x7f901c06d520 0x7f901c06f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f901c067660 msgr2=0x7f901c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f901c067660 0x7f901c069b20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9030009c40 tx=0x7f9030008040 comp rx=0 tx=0).stop 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 msgr2=0x7f903c099490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 --2- 172.21.15.119:0/264682326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f903c13be40 0x7f903c099490 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f903c073540 tx=0x7f9034007430 comp rx=0 tx=0).stop 2024-03-08T21:34:56.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9042400640 1 -- 172.21.15.119:0/264682326 reap_dead start 2024-03-08T21:34:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 shutdown_connections 2024-03-08T21:34:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 >> 172.21.15.119:0/264682326 conn(0x7f903c09a230 msgr2=0x7f903c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 shutdown_connections 2024-03-08T21:34:56.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:56.884+0000 7f9044400640 1 -- 172.21.15.119:0/264682326 wait complete. 2024-03-08T21:34:56.892 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-08T21:34:57.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 Processor -- start 2024-03-08T21:34:57.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 -- start start 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5f0406da10 0x7f5f040b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f04141480 0x7f5f040b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0406ddf0 con 0x7f5f040b6440 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f040b6190 con 0x7f5f0406da10 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f0b600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040b4570 con 0x7f5f04141480 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5efbe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5f040b6440 0x7f5f04140d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42522/0 (socket says 172.21.15.119:42522) 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5efbe00640 1 -- 172.21.15.119:0/63597130 learned_addr learned my addr 172.21.15.119:0/63597130 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:57.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f08c00640 1 --2- 172.21.15.119:0/63597130 >> v2:172.21.15.160:3300/0 conn(0x7f5f0406da10 0x7f5f040b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f09600640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f04141480 0x7f5f040b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f03e00640 1 -- 172.21.15.119:0/63597130 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426689936 0 0) 0x7f5f0406ddf0 con 0x7f5f040b6440 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.036+0000 7f5f03e00640 1 -- 172.21.15.119:0/63597130 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003530 con 0x7f5f040b6440 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f08c00640 1 -- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f04141480 msgr2=0x7f5f040b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f08c00640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f04141480 0x7f5f040b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f08c00640 1 -- 172.21.15.119:0/63597130 >> v1:172.21.15.119:6789/0 conn(0x7f5f040b6440 legacy=0x7f5f04140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f08c00640 1 -- 172.21.15.119:0/63597130 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040b4850 con 0x7f5f0406da10 2024-03-08T21:34:57.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f08c00640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f0406da10 0x7f5f040b5560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40097c0 tx=0x7f5ef401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2818835222afa9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f03e00640 1 -- 172.21.15.119:0/63597130 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40b0070 con 0x7f5f0406da10 2024-03-08T21:34:57.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f03e00640 1 -- 172.21.15.119:0/63597130 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40ab600 con 0x7f5f0406da10 2024-03-08T21:34:57.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f03e00640 1 -- 172.21.15.119:0/63597130 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40ab9b0 con 0x7f5f0406da10 2024-03-08T21:34:57.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 -- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f0406da10 msgr2=0x7f5f040b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f0406da10 0x7f5f040b5560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40097c0 tx=0x7f5ef401c410 comp rx=0 tx=0).stop 2024-03-08T21:34:57.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 -- 172.21.15.119:0/63597130 shutdown_connections 2024-03-08T21:34:57.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f04141480 0x7f5f040b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 --2- 172.21.15.119:0/63597130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f0406da10 0x7f5f040b5560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.040+0000 7f5f0b600640 1 -- 172.21.15.119:0/63597130 >> 172.21.15.119:0/63597130 conn(0x7f5f0406b6e0 msgr2=0x7f5f040ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- 172.21.15.119:0/63597130 shutdown_connections 2024-03-08T21:34:57.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- 172.21.15.119:0/63597130 wait complete. 2024-03-08T21:34:57.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 Processor -- start 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- start start 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f0406da10 0x7f5f041e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f04141480 0x7f5f041430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04154280 con 0x7f5f040b6440 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04154400 con 0x7f5f04141480 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04154580 con 0x7f5f0406da10 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60480/0 (socket says 172.21.15.119:60480) 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 -- 172.21.15.119:0/174934502 learned_addr learned my addr 172.21.15.119:0/174934502 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f08c00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f0406da10 0x7f5f041e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f09600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f04141480 0x7f5f041430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 -- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f0406da10 msgr2=0x7f5f041e3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f0406da10 0x7f5f041e3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 -- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f04141480 msgr2=0x7f5f041430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f04141480 0x7f5f041430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 -- 172.21.15.119:0/174934502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f041359b0 con 0x7f5f040b6440 2024-03-08T21:34:57.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5efbe00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c480 tx=0x7f5eec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec017070 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec005cf0 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec007290 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f041e29a0 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.044+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f041e2f60 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f04067db0 con 0x7f5f040b6440 2024-03-08T21:34:57.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5eec01a070 con 0x7f5f040b6440 2024-03-08T21:34:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f01600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 0x7f5ee0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5eec084950 con 0x7f5f040b6440 2024-03-08T21:34:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f08c00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 0x7f5ee0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.048+0000 7f5f08c00640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 0x7f5ee0069b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40ad000 tx=0x7f5ef40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.052+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f5eec055270 con 0x7f5f040b6440 2024-03-08T21:34:57.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.204+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f041e3130 con 0x7f5ee0067660 2024-03-08T21:34:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.204+0000 7f5f01600640 1 -- 172.21.15.119:0/174934502 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f041e3130 con 0x7f5ee0067660 2024-03-08T21:34:57.195 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 0 to deep-scrub 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 msgr2=0x7f5ee0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 0x7f5ee0069b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40ad000 tx=0x7f5ef40a6000 comp rx=0 tx=0).stop 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 msgr2=0x7f5f04144e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c480 tx=0x7f5eec00c940 comp rx=0 tx=0).stop 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 shutdown_connections 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ee0067660 0x7f5ee0069b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f04141480 0x7f5f041430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f040b6440 0x7f5f04144e20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 --2- 172.21.15.119:0/174934502 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f0406da10 0x7f5f041e3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 >> 172.21.15.119:0/174934502 conn(0x7f5f0406b6e0 msgr2=0x7f5f04071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 shutdown_connections 2024-03-08T21:34:57.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.208+0000 7f5f0b600640 1 -- 172.21.15.119:0/174934502 wait complete. 2024-03-08T21:34:57.216 INFO:tasks.ceph:Scrubbing osd.1 2024-03-08T21:34:57.216 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 Processor -- start 2024-03-08T21:34:57.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 -- start start 2024-03-08T21:34:57.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b9806c840 0x7f3b980b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 0x7f3b981444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 0x7f3b981413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b98144a00 con 0x7f3b9806c840 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9806cc20 con 0x7f3b98144030 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ee00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980b3670 con 0x7f3b98140fb0 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b9806c840 0x7f3b980b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b9806c840 0x7f3b980b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60482/0 (socket says 172.21.15.119:60482) 2024-03-08T21:34:57.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 -- 172.21.15.119:0/3094988433 learned_addr learned my addr 172.21.15.119:0/3094988433 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 -- 172.21.15.119:0/3094988433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 msgr2=0x7f3b981413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ce00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 0x7f3b981413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97400640 1 --2- 172.21.15.119:0/3094988433 >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 0x7f3b981444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 0x7f3b981413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 -- 172.21.15.119:0/3094988433 >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 msgr2=0x7f3b981444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3094988433 >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 0x7f3b981444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97e00640 1 -- 172.21.15.119:0/3094988433 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980b3950 con 0x7f3b9806c840 2024-03-08T21:34:57.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b9ce00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 0x7f3b981413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.364+0000 7f3b97400640 1 --2- 172.21.15.119:0/3094988433 >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 0x7f3b981444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b3090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806bac0 tx=0x7f3b8801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf72a8c2a383b500 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b96a00640 1 -- 172.21.15.119:0/3094988433 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880a5600 con 0x7f3b9806c840 2024-03-08T21:34:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b96a00640 1 -- 172.21.15.119:0/3094988433 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b880a57a0 con 0x7f3b9806c840 2024-03-08T21:34:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b96a00640 1 -- 172.21.15.119:0/3094988433 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880a5b70 con 0x7f3b9806c840 2024-03-08T21:34:57.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3094988433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 msgr2=0x7f3b980b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b3090 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806bac0 tx=0x7f3b8801c960 comp rx=0 tx=0).stop 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3094988433 shutdown_connections 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98140fb0 0x7f3b981413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3094988433 >> v2:172.21.15.160:3300/0 conn(0x7f3b98144030 0x7f3b981444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3094988433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b3090 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3094988433 >> 172.21.15.119:0/3094988433 conn(0x7f3b9809a230 msgr2=0x7f3b9809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3094988433 shutdown_connections 2024-03-08T21:34:57.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.368+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3094988433 wait complete. 2024-03-08T21:34:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 Processor -- start 2024-03-08T21:34:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- start start 2024-03-08T21:34:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b98140fb0 0x7f3b9813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98144030 0x7f3b9813eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9806e100 con 0x7f3b9806c840 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9806df80 con 0x7f3b98140fb0 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98147aa0 con 0x7f3b98144030 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60490/0 (socket says 172.21.15.119:60490) 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 -- 172.21.15.119:0/3330345109 learned_addr learned my addr 172.21.15.119:0/3330345109 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97400640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b98140fb0 0x7f3b9813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ce00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98144030 0x7f3b9813eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 -- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98144030 msgr2=0x7f3b9813eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b98144030 0x7f3b9813eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 -- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b98140fb0 msgr2=0x7f3b9813e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b98140fb0 0x7f3b9813e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98071640 con 0x7f3b9806c840 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b97e00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b1eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3b880af040 tx=0x7f3b88019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880bc020 con 0x7f3b9806c840 2024-03-08T21:34:57.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b880b8680 con 0x7f3b9806c840 2024-03-08T21:34:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b880b8a70 con 0x7f3b9806c840 2024-03-08T21:34:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b98071920 con 0x7f3b9806c840 2024-03-08T21:34:57.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9809ce30 con 0x7f3b9806c840 2024-03-08T21:34:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.372+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b98067db0 con 0x7f3b9806c840 2024-03-08T21:34:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f3b880bf020 con 0x7f3b9806c840 2024-03-08T21:34:57.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3b78067690 0x7f3b78069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b88120a90 con 0x7f3b9806c840 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b97400640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3b78067690 0x7f3b78069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7f3b7806d550 0x7f3b7806f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b78070020 con 0x7f3b7806d550 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b88120e40 con 0x7f3b9806c840 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b9ce00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7f3b7806d550 0x7f3b7806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b97400640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3b78067690 0x7f3b78069b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006fd0 tx=0x7f3b84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b9ce00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7f3b7806d550 0x7f3b7806f970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.376+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== osd.1 v2:172.21.15.119:6808/585002504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3b78070020 con 0x7f3b7806d550 2024-03-08T21:34:57.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 --> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b98099f10 con 0x7f3b7806d550 2024-03-08T21:34:57.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b8fe00640 1 -- 172.21.15.119:0/3330345109 <== osd.1 v2:172.21.15.119:6808/585002504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3b98099f10 con 0x7f3b7806d550 2024-03-08T21:34:57.381 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:57.381 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7f3b7806d550 msgr2=0x7f3b7806f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6808/585002504,v1:172.21.15.119:6809/585002504] conn(0x7f3b7806d550 0x7f3b7806f970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3b78067690 msgr2=0x7f3b78069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3b78067690 0x7f3b78069b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b84006fd0 tx=0x7f3b84008040 comp rx=0 tx=0).stop 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 msgr2=0x7f3b980b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 --2- 172.21.15.119:0/3330345109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9806c840 0x7f3b980b1eb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3b880af040 tx=0x7f3b88019700 comp rx=0 tx=0).stop 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ce00640 1 -- 172.21.15.119:0/3330345109 reap_dead start 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 shutdown_connections 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 >> 172.21.15.119:0/3330345109 conn(0x7f3b9809a230 msgr2=0x7f3b9806ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 shutdown_connections 2024-03-08T21:34:57.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.392+0000 7f3b9ee00640 1 -- 172.21.15.119:0/3330345109 wait complete. 2024-03-08T21:34:57.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-08T21:34:57.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 Processor -- start 2024-03-08T21:34:57.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 -- start start 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c09adb0 0x7fce7c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce7c1448b0 0x7fce7c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7c09b190 con 0x7fce7c072fe0 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7c09d240 con 0x7fce7c1448b0 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce82200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c09d520 con 0x7fce7c09adb0 2024-03-08T21:34:57.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce7be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce7c1448b0 0x7fce7c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce7be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce7c1448b0 0x7fce7c13d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60502/0 (socket says 172.21.15.119:60502) 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.544+0000 7fce7be00640 1 -- 172.21.15.119:0/3268436762 learned_addr learned my addr 172.21.15.119:0/3268436762 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7b400640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c09adb0 0x7fce7c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7be00640 1 -- 172.21.15.119:0/3268436762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c09adb0 msgr2=0x7fce7c09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7be00640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c09adb0 0x7fce7c09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7be00640 1 -- 172.21.15.119:0/3268436762 >> v1:172.21.15.160:6789/0 conn(0x7fce7c072fe0 legacy=0x7fce7c1441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7be00640 1 -- 172.21.15.119:0/3268436762 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c143c50 con 0x7fce7c1448b0 2024-03-08T21:34:57.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7aa00640 1 -- 172.21.15.119:0/3268436762 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996732847 0 0) 0x7fce7c09b190 con 0x7fce7c072fe0 2024-03-08T21:34:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7be00640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c1448b0 0x7fce7c13d9e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce74009870 tx=0x7fce7401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48db6931567bc11 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7aa00640 1 -- 172.21.15.119:0/3268436762 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740aa680 con 0x7fce7c1448b0 2024-03-08T21:34:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7aa00640 1 -- 172.21.15.119:0/3268436762 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740af070 con 0x7fce7c1448b0 2024-03-08T21:34:57.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.548+0000 7fce7aa00640 1 -- 172.21.15.119:0/3268436762 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740aaa40 con 0x7fce7c1448b0 2024-03-08T21:34:57.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/3268436762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c1448b0 msgr2=0x7fce7c13d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c1448b0 0x7fce7c13d9e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce74009870 tx=0x7fce7401c560 comp rx=0 tx=0).stop 2024-03-08T21:34:57.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/3268436762 shutdown_connections 2024-03-08T21:34:57.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c1448b0 0x7fce7c13d9e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- 172.21.15.119:0/3268436762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c09adb0 0x7fce7c09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/3268436762 >> 172.21.15.119:0/3268436762 conn(0x7fce7c06c620 msgr2=0x7fce7c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/3268436762 shutdown_connections 2024-03-08T21:34:57.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/3268436762 wait complete. 2024-03-08T21:34:57.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 Processor -- start 2024-03-08T21:34:57.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- start start 2024-03-08T21:34:57.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 0x7fce7c13c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 0x7fce7c1e0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c151180 con 0x7fce7c09adb0 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c151000 con 0x7fce7c1448b0 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c151300 con 0x7fce7c072fe0 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60506/0 (socket says 172.21.15.119:60506) 2024-03-08T21:34:57.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 -- 172.21.15.119:0/2911144015 learned_addr learned my addr 172.21.15.119:0/2911144015 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce7b400640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 0x7fce7c13c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce7be00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 0x7fce7c1e0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 -- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 msgr2=0x7fce7c13c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 0x7fce7c13c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 -- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 msgr2=0x7fce7c1e0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 0x7fce7c1e0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 -- 172.21.15.119:0/2911144015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c06ffa0 con 0x7fce7c09adb0 2024-03-08T21:34:57.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce7be00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 0x7fce7c1e0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce7b400640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 0x7fce7c13c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce72a00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c550 tx=0x7fce6400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64017070 con 0x7fce7c09adb0 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64003600 con 0x7fce7c09adb0 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c0ae4d0 con 0x7fce7c09adb0 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640039f0 con 0x7fce7c09adb0 2024-03-08T21:34:57.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.552+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c0aecd0 con 0x7fce7c09adb0 2024-03-08T21:34:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7c0aeff0 con 0x7fce7c09adb0 2024-03-08T21:34:57.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fce6401a070 con 0x7fce7c09adb0 2024-03-08T21:34:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce73e00640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 0x7fce58069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce64084980 con 0x7fce7c09adb0 2024-03-08T21:34:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce7b400640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 0x7fce58069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.556+0000 7fce7b400640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 0x7fce58069b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0074c0 tx=0x7fce6c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.560+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fce7c0aeff0 con 0x7fce7c09adb0 2024-03-08T21:34:57.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fce7c067db0 con 0x7fce58067690 2024-03-08T21:34:57.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce73e00640 1 -- 172.21.15.119:0/2911144015 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fce7c067db0 con 0x7fce58067690 2024-03-08T21:34:57.705 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 1 to deep-scrub 2024-03-08T21:34:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 msgr2=0x7fce58069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 0x7fce58069b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0074c0 tx=0x7fce6c00b040 comp rx=0 tx=0).stop 2024-03-08T21:34:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 msgr2=0x7fce7c0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c550 tx=0x7fce6400ca10 comp rx=0 tx=0).stop 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 shutdown_connections 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fce58067690 0x7fce58069b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce7c1448b0 0x7fce7c1e0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce7c09adb0 0x7fce7c0ad540 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 --2- 172.21.15.119:0/2911144015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce7c072fe0 0x7fce7c13c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 >> 172.21.15.119:0/2911144015 conn(0x7fce7c06c620 msgr2=0x7fce7c073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 shutdown_connections 2024-03-08T21:34:57.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.716+0000 7fce82200640 1 -- 172.21.15.119:0/2911144015 wait complete. 2024-03-08T21:34:57.725 INFO:tasks.ceph:Scrubbing osd.2 2024-03-08T21:34:57.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:57.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 Processor -- start 2024-03-08T21:34:57.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 -- start start 2024-03-08T21:34:57.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f631806c840 0x7f63180b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63181449d0 con 0x7f6318140fb0 2024-03-08T21:34:57.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631806cc20 con 0x7f631806c840 2024-03-08T21:34:57.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.872+0000 7f631ee00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180b3670 con 0x7f6318144030 2024-03-08T21:34:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f630fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f631806c840 0x7f63180b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f630fe00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:36058/0 (socket says 172.21.15.119:36058) 2024-03-08T21:34:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f630fe00640 1 -- 172.21.15.119:0/1781527196 learned_addr learned my addr 172.21.15.119:0/1781527196 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f631ce00640 1 --1- 172.21.15.119:0/1781527196 >> v1:172.21.15.160:6789/0 conn(0x7f6318140fb0 0x7f63181413e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.119:57100/0 (socket says 172.21.15.119:57100) 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 -- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 msgr2=0x7f6318144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 -- 172.21.15.119:0/1781527196 >> v1:172.21.15.160:6789/0 conn(0x7f6318140fb0 legacy=0x7f63181413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 -- 172.21.15.119:0/1781527196 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180b3950 con 0x7f631806c840 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317400640 1 -- 172.21.15.119:0/1781527196 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254949495 0 0) 0x7f63181449d0 con 0x7f6318140fb0 2024-03-08T21:34:57.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f630fe00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:57.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.876+0000 7f6317e00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f631806c840 0x7f63180b3090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6318144ba0 tx=0x7f630801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee71fb1ac074ebe1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f6317400640 1 -- 172.21.15.119:0/1781527196 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080b0070 con 0x7f631806c840 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f6317400640 1 -- 172.21.15.119:0/1781527196 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63080ab600 con 0x7f631806c840 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f6317400640 1 -- 172.21.15.119:0/1781527196 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080ab9d0 con 0x7f631806c840 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f631806c840 msgr2=0x7f63180b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f631806c840 0x7f63180b3090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6318144ba0 tx=0x7f630801c410 comp rx=0 tx=0).stop 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- 172.21.15.119:0/1781527196 shutdown_connections 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6318144030 0x7f6318144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- 172.21.15.119:0/1781527196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f631806c840 0x7f63180b3090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- 172.21.15.119:0/1781527196 >> 172.21.15.119:0/1781527196 conn(0x7f631809a230 msgr2=0x7f631809a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- 172.21.15.119:0/1781527196 shutdown_connections 2024-03-08T21:34:57.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- 172.21.15.119:0/1781527196 wait complete. 2024-03-08T21:34:57.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 Processor -- start 2024-03-08T21:34:57.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- start start 2024-03-08T21:34:57.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f631806c840 0x7f63181e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 0x7f631813d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6318144030 0x7f631809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631806da10 con 0x7f6318140fb0 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631806d890 con 0x7f6318144030 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ee00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631806db90 con 0x7f631806c840 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f630fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 0x7f631813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f6317e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f631806c840 0x7f63181e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f630fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 0x7f631813d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60512/0 (socket says 172.21.15.119:60512) 2024-03-08T21:34:57.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f630fe00640 1 -- 172.21.15.119:0/857194257 learned_addr learned my addr 172.21.15.119:0/857194257 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.880+0000 7f631ce00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6318144030 0x7f631809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 -- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6318144030 msgr2=0x7f631809bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6318144030 0x7f631809bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 -- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 msgr2=0x7f631813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 0x7f631813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631809d090 con 0x7f631806c840 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f630fe00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6318140fb0 0x7f631813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6317e00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f631806c840 0x7f63181e2750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63180b4f50 tx=0x7f630801ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080bc070 con 0x7f631806c840 2024-03-08T21:34:57.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63080b1040 con 0x7f631806c840 2024-03-08T21:34:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631809d370 con 0x7f631806c840 2024-03-08T21:34:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080b0050 con 0x7f631806c840 2024-03-08T21:34:57.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6318099d40 con 0x7f631806c840 2024-03-08T21:34:57.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6318145f40 con 0x7f631806c840 2024-03-08T21:34:57.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f63080bf070 con 0x7f631806c840 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f62f4067660 0x7f62f4069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f630811f590 con 0x7f631806c840 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f62f406d520 0x7f62f406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63080bce70 con 0x7f62f406d520 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f630fe00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f62f4067660 0x7f62f4069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.884+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f630811f940 con 0x7f631806c840 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.888+0000 7f631ce00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f62f406d520 0x7f62f406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:57.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.888+0000 7f630fe00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f62f4067660 0x7f62f4069b20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f630000b8d0 tx=0x7f630000b450 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.888+0000 7f631ce00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f62f406d520 0x7f62f406f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:57.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.888+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== osd.2 v2:172.21.15.119:6824/2768009528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f63080bce70 con 0x7f62f406d520 2024-03-08T21:34:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 --> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f631809ce90 con 0x7f62f406d520 2024-03-08T21:34:57.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f6314c00640 1 -- 172.21.15.119:0/857194257 <== osd.2 v2:172.21.15.119:6824/2768009528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f631809ce90 con 0x7f62f406d520 2024-03-08T21:34:57.890 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:57.891 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:57.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f62f406d520 msgr2=0x7f62f406f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6824/2768009528,v1:172.21.15.119:6825/2768009528] conn(0x7f62f406d520 0x7f62f406f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f62f4067660 msgr2=0x7f62f4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f62f4067660 0x7f62f4069b20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f630000b8d0 tx=0x7f630000b450 comp rx=0 tx=0).stop 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f631806c840 msgr2=0x7f63181e2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 --2- 172.21.15.119:0/857194257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f631806c840 0x7f63181e2750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63180b4f50 tx=0x7f630801ac50 comp rx=0 tx=0).stop 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ce00640 1 -- 172.21.15.119:0/857194257 reap_dead start 2024-03-08T21:34:57.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 shutdown_connections 2024-03-08T21:34:57.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 >> 172.21.15.119:0/857194257 conn(0x7f631809a230 msgr2=0x7f6318144490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:57.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 shutdown_connections 2024-03-08T21:34:57.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:57.900+0000 7f631ee00640 1 -- 172.21.15.119:0/857194257 wait complete. 2024-03-08T21:34:57.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-08T21:34:58.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 Processor -- start 2024-03-08T21:34:58.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 -- start start 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f399c09adb0 0x7f399c09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f399c072fe0 0x7f399c1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c1446e0 0x7f399c13d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c144b30 con 0x7f399c072fe0 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c09b190 con 0x7f399c09adb0 2024-03-08T21:34:58.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f39a1400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c09d240 con 0x7f399c1446e0 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f3991e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f399c072fe0 0x7f399c1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f3991e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f399c072fe0 0x7f399c1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60526/0 (socket says 172.21.15.119:60526) 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f3991e00640 1 -- 172.21.15.119:0/26671002 learned_addr learned my addr 172.21.15.119:0/26671002 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f399b200640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c1446e0 0x7f399c13d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.052+0000 7f399a800640 1 --2- 172.21.15.119:0/26671002 >> v2:172.21.15.160:3300/0 conn(0x7f399c09adb0 0x7f399c09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 -- 172.21.15.119:0/26671002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c1446e0 msgr2=0x7f399c13d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c1446e0 0x7f399c13d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 -- 172.21.15.119:0/26671002 >> v2:172.21.15.160:3300/0 conn(0x7f399c09adb0 msgr2=0x7f399c09cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:58.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 --2- 172.21.15.119:0/26671002 >> v2:172.21.15.160:3300/0 conn(0x7f399c09adb0 0x7f399c09cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 -- 172.21.15.119:0/26671002 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c09d520 con 0x7f399c072fe0 2024-03-08T21:34:58.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3991e00640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1441a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f399c06f120 tx=0x7f398401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564972da870261c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3999e00640 1 -- 172.21.15.119:0/26671002 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840ab640 con 0x7f399c072fe0 2024-03-08T21:34:58.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3999e00640 1 -- 172.21.15.119:0/26671002 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840b0070 con 0x7f399c072fe0 2024-03-08T21:34:58.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f3999e00640 1 -- 172.21.15.119:0/26671002 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840aba00 con 0x7f399c072fe0 2024-03-08T21:34:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f39a1400640 1 -- 172.21.15.119:0/26671002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 msgr2=0x7f399c1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f39a1400640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1441a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f399c06f120 tx=0x7f398401c4c0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f39a1400640 1 -- 172.21.15.119:0/26671002 shutdown_connections 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.056+0000 7f39a1400640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c1446e0 0x7f399c13d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 --2- 172.21.15.119:0/26671002 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1441a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 --2- 172.21.15.119:0/26671002 >> v2:172.21.15.160:3300/0 conn(0x7f399c09adb0 0x7f399c09cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- 172.21.15.119:0/26671002 >> 172.21.15.119:0/26671002 conn(0x7f399c06c620 msgr2=0x7f399c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- 172.21.15.119:0/26671002 shutdown_connections 2024-03-08T21:34:58.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- 172.21.15.119:0/26671002 wait complete. 2024-03-08T21:34:58.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 Processor -- start 2024-03-08T21:34:58.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- start start 2024-03-08T21:34:58.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c09adb0 0x7f399c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 0x7f399c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c147bd0 con 0x7f399c072fe0 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c147a50 con 0x7f399c1446e0 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c147d50 con 0x7f399c09adb0 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60528/0 (socket says 172.21.15.119:60528) 2024-03-08T21:34:58.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 -- 172.21.15.119:0/1129238049 learned_addr learned my addr 172.21.15.119:0/1129238049 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f3991e00640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c09adb0 0x7f399c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399b200640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 0x7f399c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 -- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c09adb0 msgr2=0x7f399c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c09adb0 0x7f399c13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 -- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 msgr2=0x7f399c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 0x7f399c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 -- 172.21.15.119:0/1129238049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c13ffe0 con 0x7f399c072fe0 2024-03-08T21:34:58.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399b200640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 0x7f399c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f399a800640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e930 tx=0x7f398c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c017070 con 0x7f399c072fe0 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00ca00 con 0x7f399c072fe0 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c13f800 con 0x7f399c072fe0 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00cdb0 con 0x7f399c072fe0 2024-03-08T21:34:58.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.060+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c140250 con 0x7f399c072fe0 2024-03-08T21:34:58.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c067db0 con 0x7f399c072fe0 2024-03-08T21:34:58.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f399c072fe0 2024-03-08T21:34:58.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f3993400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 0x7f3978069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f398c0854a0 con 0x7f399c072fe0 2024-03-08T21:34:58.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f3991e00640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 0x7f3978069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.064+0000 7f3991e00640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 0x7f3978069b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39840af000 tx=0x7f39840a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.068+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f398c055f20 con 0x7f399c072fe0 2024-03-08T21:34:58.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f399c0b29c0 con 0x7f3978067690 2024-03-08T21:34:58.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f3993400640 1 -- 172.21.15.119:0/1129238049 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f399c0b29c0 con 0x7f3978067690 2024-03-08T21:34:58.214 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 2 to deep-scrub 2024-03-08T21:34:58.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 msgr2=0x7f3978069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 0x7f3978069b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f39840af000 tx=0x7f39840a7000 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 msgr2=0x7f399c1e31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e930 tx=0x7f398c00edf0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 shutdown_connections 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3978067690 0x7f3978069b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f399c1446e0 0x7f399c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f399c09adb0 0x7f399c13efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 --2- 172.21.15.119:0/1129238049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f399c072fe0 0x7f399c1e31a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 >> 172.21.15.119:0/1129238049 conn(0x7f399c06c620 msgr2=0x7f399c0b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 shutdown_connections 2024-03-08T21:34:58.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.224+0000 7f39a1400640 1 -- 172.21.15.119:0/1129238049 wait complete. 2024-03-08T21:34:58.234 INFO:tasks.ceph:Scrubbing osd.3 2024-03-08T21:34:58.234 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:58.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 Processor -- start 2024-03-08T21:34:58.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 -- start start 2024-03-08T21:34:58.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2ba0144740 0x7f2ba00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba006cc20 con 0x7f2ba006c840 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00b3670 con 0x7f2ba0140fb0 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba8000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00b3950 con 0x7f2ba0144740 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba5600640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2ba006c840 0x7f2ba0144030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42532/0 (socket says 172.21.15.119:42532) 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba5600640 1 -- 172.21.15.119:0/3700818013 learned_addr learned my addr 172.21.15.119:0/3700818013 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba4c00640 1 --2- 172.21.15.119:0/3700818013 >> v2:172.21.15.160:3300/0 conn(0x7f2ba0144740 0x7f2ba00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367785095 0 0) 0x7f2ba006cc20 con 0x7f2ba006c840 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88003530 con 0x7f2ba006c840 2024-03-08T21:34:58.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba4c00640 1 -- 172.21.15.119:0/3700818013 >> v1:172.21.15.160:6789/0 conn(0x7f2ba0140fb0 legacy=0x7f2ba01413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973316231 0 0) 0x7f2ba00b3670 con 0x7f2ba0140fb0 2024-03-08T21:34:58.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba4c00640 1 -- 172.21.15.119:0/3700818013 >> v1:172.21.15.119:6789/0 conn(0x7f2ba006c840 legacy=0x7f2ba0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.384+0000 7f2ba4c00640 1 -- 172.21.15.119:0/3700818013 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00b3c30 con 0x7f2ba0144740 2024-03-08T21:34:58.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba4c00640 1 --2- 172.21.15.119:0/3700818013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0144740 0x7f2ba00b3090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0097c0 tx=0x7f2b8c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1a20b6944b10c65 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0b0070 con 0x7f2ba0144740 2024-03-08T21:34:58.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c0ab600 con 0x7f2ba0144740 2024-03-08T21:34:58.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2b9fe00640 1 -- 172.21.15.119:0/3700818013 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0ab9d0 con 0x7f2ba0144740 2024-03-08T21:34:58.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- 172.21.15.119:0/3700818013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0144740 msgr2=0x7f2ba00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 --2- 172.21.15.119:0/3700818013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0144740 0x7f2ba00b3090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0097c0 tx=0x7f2b8c01c410 comp rx=0 tx=0).stop 2024-03-08T21:34:58.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- 172.21.15.119:0/3700818013 shutdown_connections 2024-03-08T21:34:58.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 --2- 172.21.15.119:0/3700818013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0144740 0x7f2ba00b3090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- 172.21.15.119:0/3700818013 >> 172.21.15.119:0/3700818013 conn(0x7f2ba009a230 msgr2=0x7f2ba009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- 172.21.15.119:0/3700818013 shutdown_connections 2024-03-08T21:34:58.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- 172.21.15.119:0/3700818013 wait complete. 2024-03-08T21:34:58.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 Processor -- start 2024-03-08T21:34:58.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.388+0000 7f2ba8000640 1 -- start start 2024-03-08T21:34:58.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 0x7f2ba013dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0140fb0 0x7f2ba00700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba0144740 0x7f2ba01df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0152000 con 0x7f2ba006c840 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba006e190 con 0x7f2ba0140fb0 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0152180 con 0x7f2ba0144740 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 0x7f2ba013dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 0x7f2ba013dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60542/0 (socket says 172.21.15.119:60542) 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 -- 172.21.15.119:0/2213591361 learned_addr learned my addr 172.21.15.119:0/2213591361 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 -- 172.21.15.119:0/2213591361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba0144740 msgr2=0x7f2ba01df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2ba0144740 0x7f2ba01df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 -- 172.21.15.119:0/2213591361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0140fb0 msgr2=0x7f2ba00700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ba0140fb0 0x7f2ba00700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0070820 con 0x7f2ba006c840 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba5600640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 0x7f2ba013dd70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c450 tx=0x7f2b9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94017070 con 0x7f2ba006c840 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94005db0 con 0x7f2ba006c840 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94007290 con 0x7f2ba006c840 2024-03-08T21:34:58.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba006f9c0 con 0x7f2ba006c840 2024-03-08T21:34:58.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01dfdd0 con 0x7f2ba006c840 2024-03-08T21:34:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ba009ca20 con 0x7f2ba006c840 2024-03-08T21:34:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.392+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f2b9401a070 con 0x7f2ba006c840 2024-03-08T21:34:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2b80067660 0x7f2b80069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2b940848f0 con 0x7f2ba006c840 2024-03-08T21:34:58.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2ba4c00640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2b80067660 0x7f2b80069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7f2b8006d520 0x7f2b8006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b8006fff0 con 0x7f2b8006d520 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b940892c0 con 0x7f2ba006c840 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2ba6000640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7f2b8006d520 0x7f2b8006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2ba4c00640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2b80067660 0x7f2b80069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2ba6000640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7f2b8006d520 0x7f2b8006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.396+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== osd.3 v2:172.21.15.119:6816/937098264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2b8006fff0 con 0x7f2b8006d520 2024-03-08T21:34:58.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 --> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ba0067db0 con 0x7f2b8006d520 2024-03-08T21:34:58.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2b9d600640 1 -- 172.21.15.119:0/2213591361 <== osd.3 v2:172.21.15.119:6816/937098264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ba0067db0 con 0x7f2b8006d520 2024-03-08T21:34:58.399 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:58.399 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:58.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7f2b8006d520 msgr2=0x7f2b8006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6816/937098264,v1:172.21.15.119:6817/937098264] conn(0x7f2b8006d520 0x7f2b8006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2b80067660 msgr2=0x7f2b80069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f2b80067660 0x7f2b80069b20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ad000 tx=0x7f2b8c004740 comp rx=0 tx=0).stop 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 msgr2=0x7f2ba013dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 --2- 172.21.15.119:0/2213591361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ba006c840 0x7f2ba013dd70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c450 tx=0x7f2b9400c910 comp rx=0 tx=0).stop 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba6000640 1 -- 172.21.15.119:0/2213591361 reap_dead start 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 shutdown_connections 2024-03-08T21:34:58.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 >> 172.21.15.119:0/2213591361 conn(0x7f2ba009a230 msgr2=0x7f2ba00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 shutdown_connections 2024-03-08T21:34:58.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.408+0000 7f2ba8000640 1 -- 172.21.15.119:0/2213591361 wait complete. 2024-03-08T21:34:58.417 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-08T21:34:58.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 Processor -- start 2024-03-08T21:34:58.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 -- start start 2024-03-08T21:34:58.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f76bc0b4f40 0x7f76bc06de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc0ae4d0 con 0x7f76bc072410 2024-03-08T21:34:58.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0ae740 con 0x7f76bc0b4f40 2024-03-08T21:34:58.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c2c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc066e00 con 0x7f76bc1445e0 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c0c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c0c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:36108/0 (socket says 172.21.15.119:36108) 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c0c00640 1 -- 172.21.15.119:0/1837185378 learned_addr learned my addr 172.21.15.119:0/1837185378 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76bbe00640 1 --2- 172.21.15.119:0/1837185378 >> v2:172.21.15.160:3300/0 conn(0x7f76bc0b4f40 0x7f76bc06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76bbe00640 1 -- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 msgr2=0x7f76bc151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:58.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76bbe00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76bbe00640 1 -- 172.21.15.119:0/1837185378 >> v1:172.21.15.160:6789/0 conn(0x7f76bc072410 legacy=0x7f76bc143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76bbe00640 1 -- 172.21.15.119:0/1837185378 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc144a30 con 0x7f76bc0b4f40 2024-03-08T21:34:58.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.564+0000 7f76c0c00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:34:58.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76bbe00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc06de00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0097c0 tx=0x7f76ac01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3480fa8d2db1901 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76bb400640 1 -- 172.21.15.119:0/1837185378 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0b5070 con 0x7f76bc0b4f40 2024-03-08T21:34:58.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76bb400640 1 -- 172.21.15.119:0/1837185378 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac0a8990 con 0x7f76bc0b4f40 2024-03-08T21:34:58.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76bb400640 1 -- 172.21.15.119:0/1837185378 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0a8d60 con 0x7f76bc0b4f40 2024-03-08T21:34:58.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 -- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 msgr2=0x7f76bc06de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc06de00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0097c0 tx=0x7f76ac01ec90 comp rx=0 tx=0).stop 2024-03-08T21:34:58.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 -- 172.21.15.119:0/1837185378 shutdown_connections 2024-03-08T21:34:58.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc1445e0 0x7f76bc151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 --2- 172.21.15.119:0/1837185378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc06de00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 -- 172.21.15.119:0/1837185378 >> 172.21.15.119:0/1837185378 conn(0x7f76bc0b5870 msgr2=0x7f76bc0b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 -- 172.21.15.119:0/1837185378 shutdown_connections 2024-03-08T21:34:58.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.568+0000 7f76c2c00640 1 -- 172.21.15.119:0/1837185378 wait complete. 2024-03-08T21:34:58.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 Processor -- start 2024-03-08T21:34:58.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- start start 2024-03-08T21:34:58.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc072410 0x7f76bc14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc1dc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0aff10 con 0x7f76bc1445e0 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0670a0 con 0x7f76bc0b4f40 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc06e340 con 0x7f76bc072410 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60554/0 (socket says 172.21.15.119:60554) 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 -- 172.21.15.119:0/304113919 learned_addr learned my addr 172.21.15.119:0/304113919 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76bbe00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc072410 0x7f76bc14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76b3400640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc1dc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 -- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc072410 msgr2=0x7f76bc14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc072410 0x7f76bc14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 -- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 msgr2=0x7f76bc1dc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc1dc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 -- 172.21.15.119:0/304113919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc13dcf0 con 0x7f76bc1445e0 2024-03-08T21:34:58.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c0c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76b400e960 tx=0x7f76b400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4017070 con 0x7f76bc1445e0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b400ca00 con 0x7f76bc1445e0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc146c20 con 0x7f76bc1445e0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400cdd0 con 0x7f76bc1445e0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc13df60 con 0x7f76bc1445e0 2024-03-08T21:34:58.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.572+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc067db0 con 0x7f76bc1445e0 2024-03-08T21:34:58.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.576+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f76b4013470 con 0x7f76bc1445e0 2024-03-08T21:34:58.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.576+0000 7f76b8c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 0x7f7698069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.576+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76b40852e0 con 0x7f76bc1445e0 2024-03-08T21:34:58.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.576+0000 7f76bbe00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 0x7f7698069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.576+0000 7f76bbe00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 0x7f7698069b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0b2000 tx=0x7f76ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.580+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f76b4055c00 con 0x7f76bc1445e0 2024-03-08T21:34:58.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f76bc0b6f30 con 0x7f7698067690 2024-03-08T21:34:58.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76b8c00640 1 -- 172.21.15.119:0/304113919 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f76bc0b6f30 con 0x7f7698067690 2024-03-08T21:34:58.725 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 3 to deep-scrub 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 msgr2=0x7f7698069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 0x7f7698069b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0b2000 tx=0x7f76ac008040 comp rx=0 tx=0).stop 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 msgr2=0x7f76bc1dcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76b400e960 tx=0x7f76b400ee20 comp rx=0 tx=0).stop 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 shutdown_connections 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f7698067690 0x7f7698069b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc1445e0 0x7f76bc1dcea0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76bc0b4f40 0x7f76bc1dc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 --2- 172.21.15.119:0/304113919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76bc072410 0x7f76bc14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 >> 172.21.15.119:0/304113919 conn(0x7f76bc0b5870 msgr2=0x7f76bc143ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 shutdown_connections 2024-03-08T21:34:58.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.736+0000 7f76c2c00640 1 -- 172.21.15.119:0/304113919 wait complete. 2024-03-08T21:34:58.745 INFO:tasks.ceph:Scrubbing osd.4 2024-03-08T21:34:58.746 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:58.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.892+0000 7f89a8000640 1 Processor -- start 2024-03-08T21:34:58.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.892+0000 7f89a8000640 1 -- start start 2024-03-08T21:34:58.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a8000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f89a0145b30 0x7f89a0142380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a8000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a00b4690 0x7f89a014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a8000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a006e0b0 con 0x7f89a00b42b0 2024-03-08T21:34:58.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a8000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a01456a0 con 0x7f89a00b4690 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a8000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00b3850 con 0x7f89a0145b30 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a00b4690 0x7f89a014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f89a00b4690 0x7f89a014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60558/0 (socket says 172.21.15.119:60558) 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 -- 172.21.15.119:0/1689989565 learned_addr learned my addr 172.21.15.119:0/1689989565 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a4c00640 1 --2- 172.21.15.119:0/1689989565 >> v2:172.21.15.160:3300/0 conn(0x7f89a0145b30 0x7f89a0142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 -- 172.21.15.119:0/1689989565 >> v2:172.21.15.160:3300/0 conn(0x7f89a0145b30 msgr2=0x7f89a0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 --2- 172.21.15.119:0/1689989565 >> v2:172.21.15.160:3300/0 conn(0x7f89a0145b30 0x7f89a0142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 -- 172.21.15.119:0/1689989565 >> v1:172.21.15.160:6789/0 conn(0x7f89a00b42b0 legacy=0x7f89a006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.896+0000 7f89a6000640 1 -- 172.21.15.119:0/1689989565 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0145050 con 0x7f89a00b4690 2024-03-08T21:34:58.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a6000640 1 --2- 172.21.15.119:0/1689989565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b4690 0x7f89a014f6e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f89a0067280 tx=0x7f899801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ded60f51f74728 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f899fe00640 1 -- 172.21.15.119:0/1689989565 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980b1070 con 0x7f89a00b4690 2024-03-08T21:34:58.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f899fe00640 1 -- 172.21.15.119:0/1689989565 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980ac600 con 0x7f89a00b4690 2024-03-08T21:34:58.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f899fe00640 1 -- 172.21.15.119:0/1689989565 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980ac9d0 con 0x7f89a00b4690 2024-03-08T21:34:58.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- 172.21.15.119:0/1689989565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b4690 msgr2=0x7f89a014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- 172.21.15.119:0/1689989565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b4690 0x7f89a014f6e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f89a0067280 tx=0x7f899801c490 comp rx=0 tx=0).stop 2024-03-08T21:34:58.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- 172.21.15.119:0/1689989565 shutdown_connections 2024-03-08T21:34:58.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- 172.21.15.119:0/1689989565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b4690 0x7f89a014f6e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- 172.21.15.119:0/1689989565 >> v2:172.21.15.160:3300/0 conn(0x7f89a0145b30 0x7f89a0142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- 172.21.15.119:0/1689989565 >> 172.21.15.119:0/1689989565 conn(0x7f89a009a230 msgr2=0x7f89a009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- 172.21.15.119:0/1689989565 shutdown_connections 2024-03-08T21:34:58.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- 172.21.15.119:0/1689989565 wait complete. 2024-03-08T21:34:58.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 Processor -- start 2024-03-08T21:34:58.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- start start 2024-03-08T21:34:58.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 0x7f89a0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89a00b4690 0x7f89a01e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89a0145b30 0x7f89a01e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01527d0 con 0x7f89a00b42b0 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0152650 con 0x7f89a00b4690 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a8000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0152950 con 0x7f89a0145b30 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a5600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 0x7f89a0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a5600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 0x7f89a0071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60568/0 (socket says 172.21.15.119:60568) 2024-03-08T21:34:58.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a5600640 1 -- 172.21.15.119:0/2029801249 learned_addr learned my addr 172.21.15.119:0/2029801249 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a4c00640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89a00b4690 0x7f89a01e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.900+0000 7f89a6000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89a0145b30 0x7f89a01e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 -- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89a0145b30 msgr2=0x7f89a01e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89a0145b30 0x7f89a01e05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 -- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89a00b4690 msgr2=0x7f89a01e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89a00b4690 0x7f89a01e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0072900 con 0x7f89a00b42b0 2024-03-08T21:34:58.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a5600640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 0x7f89a0071620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f899400c730 tx=0x7f899400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994016020 con 0x7f89a00b42b0 2024-03-08T21:34:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994006d60 con 0x7f89a00b42b0 2024-03-08T21:34:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994003bc0 con 0x7f89a00b42b0 2024-03-08T21:34:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a0070250 con 0x7f89a00b42b0 2024-03-08T21:34:58.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00b2210 con 0x7f89a00b42b0 2024-03-08T21:34:58.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89a01dfc50 con 0x7f89a00b42b0 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f899400a850 con 0x7f89a00b42b0 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8980067660 0x7f8980069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8994085f40 con 0x7f89a00b42b0 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f89a4c00640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8980067660 0x7f8980069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f898006d520 0x7f898006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8994024e50 con 0x7f898006d520 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.904+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89940862f0 con 0x7f89a00b42b0 2024-03-08T21:34:58.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.908+0000 7f89a6000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f898006d520 0x7f898006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.908+0000 7f89a4c00640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8980067660 0x7f8980069b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f89a01e0ca0 tx=0x7f898c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.908+0000 7f89a6000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f898006d520 0x7f898006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:58.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.908+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== osd.4 v2:172.21.15.160:6800/1676941405 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8994024e50 con 0x7f898006d520 2024-03-08T21:34:58.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.920+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 --> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f89a0067db0 con 0x7f898006d520 2024-03-08T21:34:58.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.920+0000 7f899d600640 1 -- 172.21.15.119:0/2029801249 <== osd.4 v2:172.21.15.160:6800/1676941405 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f89a0067db0 con 0x7f898006d520 2024-03-08T21:34:58.914 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:58.914 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:58.914 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:58.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f898006d520 msgr2=0x7f898006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.160:6800/1676941405,v1:172.21.15.160:6801/1676941405] conn(0x7f898006d520 0x7f898006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8980067660 msgr2=0x7f8980069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f8980067660 0x7f8980069b20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f89a01e0ca0 tx=0x7f898c008040 comp rx=0 tx=0).stop 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 msgr2=0x7f89a0071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 --2- 172.21.15.119:0/2029801249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89a00b42b0 0x7f89a0071620 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f899400c730 tx=0x7f899400cbf0 comp rx=0 tx=0).stop 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a6000640 1 -- 172.21.15.119:0/2029801249 reap_dead start 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 shutdown_connections 2024-03-08T21:34:58.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 >> 172.21.15.119:0/2029801249 conn(0x7f89a009a230 msgr2=0x7f89a00b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:58.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 shutdown_connections 2024-03-08T21:34:58.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:58.924+0000 7f89a8000640 1 -- 172.21.15.119:0/2029801249 wait complete. 2024-03-08T21:34:58.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-08T21:34:59.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 Processor -- start 2024-03-08T21:34:59.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 -- start start 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 0x7f28d40b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d406e430 con 0x7f28d40b56d0 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d406b390 con 0x7f28d40afcc0 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d8a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b4d00 con 0x7f28d406afb0 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d2800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f28d40b56d0 0x7f28d406dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42546/0 (socket says 172.21.15.119:42546) 2024-03-08T21:34:59.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d2800640 1 -- 172.21.15.119:0/1294031912 learned_addr learned my addr 172.21.15.119:0/1294031912 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:34:59.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d1e00640 1 --2- 172.21.15.119:0/1294031912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 0x7f28d40b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686895111 0 0) 0x7f28d406e430 con 0x7f28d40b56d0 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b8003530 con 0x7f28d40b56d0 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082900636 0 0) 0x7f28d406b390 con 0x7f28d40afcc0 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d406e430 con 0x7f28d40afcc0 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d1e00640 1 -- 172.21.15.119:0/1294031912 >> v1:172.21.15.160:6789/0 conn(0x7f28d40afcc0 legacy=0x7f28d406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d1e00640 1 -- 172.21.15.119:0/1294031912 >> v1:172.21.15.119:6789/0 conn(0x7f28d40b56d0 legacy=0x7f28d406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.076+0000 7f28d1e00640 1 -- 172.21.15.119:0/1294031912 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40af2e0 con 0x7f28d406afb0 2024-03-08T21:34:59.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d1e00640 1 --2- 172.21.15.119:0/1294031912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 0x7f28d40b5190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097f0 tx=0x7f28bc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17184a049ae60c24 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b0070 con 0x7f28d406afb0 2024-03-08T21:34:59.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0ab600 con 0x7f28d406afb0 2024-03-08T21:34:59.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d0a00640 1 -- 172.21.15.119:0/1294031912 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0ab9d0 con 0x7f28d406afb0 2024-03-08T21:34:59.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 -- 172.21.15.119:0/1294031912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 msgr2=0x7f28d40b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 --2- 172.21.15.119:0/1294031912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 0x7f28d40b5190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097f0 tx=0x7f28bc01c450 comp rx=0 tx=0).stop 2024-03-08T21:34:59.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 -- 172.21.15.119:0/1294031912 shutdown_connections 2024-03-08T21:34:59.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 --2- 172.21.15.119:0/1294031912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d406afb0 0x7f28d40b5190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 -- 172.21.15.119:0/1294031912 >> 172.21.15.119:0/1294031912 conn(0x7f28d40b9700 msgr2=0x7f28d40b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 -- 172.21.15.119:0/1294031912 shutdown_connections 2024-03-08T21:34:59.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.080+0000 7f28d8a00640 1 -- 172.21.15.119:0/1294031912 wait complete. 2024-03-08T21:34:59.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 Processor -- start 2024-03-08T21:34:59.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- start start 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d40afcc0 0x7f28d4144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 0x7f28d41e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4155580 con 0x7f28d406afb0 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4155400 con 0x7f28d40b56d0 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4155700 con 0x7f28d40afcc0 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60584/0 (socket says 172.21.15.119:60584) 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 -- 172.21.15.119:0/2713953224 learned_addr learned my addr 172.21.15.119:0/2713953224 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1400640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d40afcc0 0x7f28d4144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d2800640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 0x7f28d41e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 -- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d40afcc0 msgr2=0x7f28d4144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d40afcc0 0x7f28d4144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 -- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 msgr2=0x7f28d41e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 0x7f28d41e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 -- 172.21.15.119:0/2713953224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4070850 con 0x7f28d406afb0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d2800640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 0x7f28d41e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d1e00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f28bc019060 tx=0x7f28bc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b0040 con 0x7f28d406afb0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0b9070 con 0x7f28d406afb0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b4690 con 0x7f28d406afb0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d40b0a40 con 0x7f28d406afb0 2024-03-08T21:34:59.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4144ea0 con 0x7f28d406afb0 2024-03-08T21:34:59.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.084+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4067db0 con 0x7f28d406afb0 2024-03-08T21:34:59.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.088+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f28bc0b4830 con 0x7f28d406afb0 2024-03-08T21:34:59.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.088+0000 7f28ca000640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 0x7f28b0069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.088+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28bc11f0a0 con 0x7f28d406afb0 2024-03-08T21:34:59.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.088+0000 7f28d1400640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 0x7f28b0069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.088+0000 7f28d1400640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 0x7f28b0069b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f28d409b440 tx=0x7f28c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.092+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f28bc0160d0 con 0x7f28d406afb0 2024-03-08T21:34:59.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f28d4143eb0 con 0x7f28b0067690 2024-03-08T21:34:59.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28ca000640 1 -- 172.21.15.119:0/2713953224 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28d4143eb0 con 0x7f28b0067690 2024-03-08T21:34:59.240 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 4 to deep-scrub 2024-03-08T21:34:59.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 msgr2=0x7f28b0069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 0x7f28b0069b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f28d409b440 tx=0x7f28c4009040 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 msgr2=0x7f28d409acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f28bc019060 tx=0x7f28bc0191f0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 shutdown_connections 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f28b0067690 0x7f28b0069b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28d40b56d0 0x7f28d41e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28d40afcc0 0x7f28d4144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 --2- 172.21.15.119:0/2713953224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28d406afb0 0x7f28d409acf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 >> 172.21.15.119:0/2713953224 conn(0x7f28d40b9700 msgr2=0x7f28d409d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 shutdown_connections 2024-03-08T21:34:59.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.248+0000 7f28d8a00640 1 -- 172.21.15.119:0/2713953224 wait complete. 2024-03-08T21:34:59.259 INFO:tasks.ceph:Scrubbing osd.5 2024-03-08T21:34:59.259 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.412+0000 7f1b91e00640 1 Processor -- start 2024-03-08T21:34:59.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.412+0000 7f1b91e00640 1 -- start start 2024-03-08T21:34:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.412+0000 7f1b91e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1b8c06c840 0x7f1b8c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.412+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c144030 0x7f1b8c144490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b91e00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1b8c140fb0 0x7f1b8c1413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b91e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c1449d0 con 0x7f1b8c06c840 2024-03-08T21:34:59.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b91e00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c06cc20 con 0x7f1b8c140fb0 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b91e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0b3670 con 0x7f1b8c144030 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1b8c06c840 0x7f1b8c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1b8c06c840 0x7f1b8c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60596/0 (socket says 172.21.15.119:60596) 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 -- 172.21.15.119:0/1974141310 learned_addr learned my addr 172.21.15.119:0/1974141310 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b82000640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c144030 0x7f1b8c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8b400640 1 --2- 172.21.15.119:0/1974141310 >> v2:172.21.15.160:3300/0 conn(0x7f1b8c140fb0 0x7f1b8c1413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 -- 172.21.15.119:0/1974141310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c144030 msgr2=0x7f1b8c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:59.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c144030 0x7f1b8c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 -- 172.21.15.119:0/1974141310 >> v2:172.21.15.160:3300/0 conn(0x7f1b8c140fb0 msgr2=0x7f1b8c1413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:59.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/1974141310 >> v2:172.21.15.160:3300/0 conn(0x7f1b8c140fb0 0x7f1b8c1413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 -- 172.21.15.119:0/1974141310 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0b3950 con 0x7f1b8c06c840 2024-03-08T21:34:59.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c06c840 0x7f1b8c0b3090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c09d690 tx=0x7f1b7c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9f80e339138394 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8a000640 1 -- 172.21.15.119:0/1974141310 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0a5600 con 0x7f1b8c06c840 2024-03-08T21:34:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8a000640 1 -- 172.21.15.119:0/1974141310 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0a57a0 con 0x7f1b8c06c840 2024-03-08T21:34:59.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.416+0000 7f1b8a000640 1 -- 172.21.15.119:0/1974141310 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0a5b70 con 0x7f1b8c06c840 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- 172.21.15.119:0/1974141310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c06c840 msgr2=0x7f1b8c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c06c840 0x7f1b8c0b3090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c09d690 tx=0x7f1b7c01c960 comp rx=0 tx=0).stop 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- 172.21.15.119:0/1974141310 shutdown_connections 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- 172.21.15.119:0/1974141310 >> v2:172.21.15.160:3300/0 conn(0x7f1b8c140fb0 0x7f1b8c1413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c144030 0x7f1b8c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- 172.21.15.119:0/1974141310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c06c840 0x7f1b8c0b3090 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- 172.21.15.119:0/1974141310 >> 172.21.15.119:0/1974141310 conn(0x7f1b8c09a230 msgr2=0x7f1b8c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- 172.21.15.119:0/1974141310 shutdown_connections 2024-03-08T21:34:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- 172.21.15.119:0/1974141310 wait complete. 2024-03-08T21:34:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 Processor -- start 2024-03-08T21:34:59.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- start start 2024-03-08T21:34:59.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c06c840 0x7f1b8c13b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b8c140fb0 0x7f1b8c1e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 0x7f1b8c1e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c06e100 con 0x7f1b8c144030 2024-03-08T21:34:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c06df80 con 0x7f1b8c140fb0 2024-03-08T21:34:59.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b91e00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c147aa0 con 0x7f1b8c06c840 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 0x7f1b8c1e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 0x7f1b8c1e1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60602/0 (socket says 172.21.15.119:60602) 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 -- 172.21.15.119:0/2340465832 learned_addr learned my addr 172.21.15.119:0/2340465832 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 -- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c06c840 msgr2=0x7f1b8c13b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c06c840 0x7f1b8c13b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b82000640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b8c140fb0 0x7f1b8c1e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c06c840 0x7f1b8c13b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 -- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b8c140fb0 msgr2=0x7f1b8c1e0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b8c140fb0 0x7f1b8c1e0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8b400640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c072be0 con 0x7f1b8c144030 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8c06c840 0x7f1b8c13b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.420+0000 7f1b82000640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b8c140fb0 0x7f1b8c1e0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b8b400640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 0x7f1b8c1e1440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e960 tx=0x7f1b8400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84017070 con 0x7f1b8c144030 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400c9a0 con 0x7f1b8c144030 2024-03-08T21:34:59.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400cd70 con 0x7f1b8c144030 2024-03-08T21:34:59.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c0ae790 con 0x7f1b8c144030 2024-03-08T21:34:59.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c0ae4b0 con 0x7f1b8c144030 2024-03-08T21:34:59.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b8c1e0ae0 con 0x7f1b8c144030 2024-03-08T21:34:59.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1b8401a070 con 0x7f1b8c144030 2024-03-08T21:34:59.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1b68067660 0x7f1b68069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1b84085530 con 0x7f1b8c144030 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1b68067660 0x7f1b68069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f1b6806d520 0x7f1b6806f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b6806fff0 con 0x7f1b6806d520 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b8408c050 con 0x7f1b8c144030 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b82000640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f1b6806d520 0x7f1b6806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.424+0000 7f1b8aa00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1b68067660 0x7f1b68069b20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ae000 tx=0x7f1b7c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.428+0000 7f1b82000640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f1b6806d520 0x7f1b6806f940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.428+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== osd.5 v2:172.21.15.160:6816/3177605674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1b6806fff0 con 0x7f1b6806d520 2024-03-08T21:34:59.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 --> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b8c067db0 con 0x7f1b6806d520 2024-03-08T21:34:59.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b83e00640 1 -- 172.21.15.119:0/2340465832 <== osd.5 v2:172.21.15.160:6816/3177605674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1b8c067db0 con 0x7f1b6806d520 2024-03-08T21:34:59.431 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:59.432 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:59.432 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f1b6806d520 msgr2=0x7f1b6806f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.160:6816/3177605674,v1:172.21.15.160:6817/3177605674] conn(0x7f1b6806d520 0x7f1b6806f940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1b68067660 msgr2=0x7f1b68069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1b68067660 0x7f1b68069b20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ae000 tx=0x7f1b7c0a7070 comp rx=0 tx=0).stop 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 msgr2=0x7f1b8c1e1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 --2- 172.21.15.119:0/2340465832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b8c144030 0x7f1b8c1e1440 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e960 tx=0x7f1b8400ee20 comp rx=0 tx=0).stop 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b8b400640 1 -- 172.21.15.119:0/2340465832 reap_dead start 2024-03-08T21:34:59.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 shutdown_connections 2024-03-08T21:34:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 >> 172.21.15.119:0/2340465832 conn(0x7f1b8c09a230 msgr2=0x7f1b8c0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 shutdown_connections 2024-03-08T21:34:59.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.440+0000 7f1b91e00640 1 -- 172.21.15.119:0/2340465832 wait complete. 2024-03-08T21:34:59.450 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-08T21:34:59.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 Processor -- start 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 -- start start 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbc200b4410 0x7fbc200b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc2013f2b0 0x7fbc200b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200b2be0 con 0x7fbc200b47f0 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200b5970 con 0x7fbc2013f2b0 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc25800640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc200b5fb0 con 0x7fbc200b4410 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc2013f2b0 0x7fbc200b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbc2013f2b0 0x7fbc200b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60618/0 (socket says 172.21.15.119:60618) 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 -- 172.21.15.119:0/3822125159 learned_addr learned my addr 172.21.15.119:0/3822125159 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1ea00640 1 --2- 172.21.15.119:0/3822125159 >> v2:172.21.15.160:3300/0 conn(0x7fbc200b4410 0x7fbc200b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 -- 172.21.15.119:0/3822125159 >> v2:172.21.15.160:3300/0 conn(0x7fbc200b4410 msgr2=0x7fbc200b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 --2- 172.21.15.119:0/3822125159 >> v2:172.21.15.160:3300/0 conn(0x7fbc200b4410 0x7fbc200b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 -- 172.21.15.119:0/3822125159 >> v1:172.21.15.160:6789/0 conn(0x7fbc200b47f0 legacy=0x7fbc2013eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.600+0000 7fbc1f400640 1 -- 172.21.15.119:0/3822125159 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b5600 con 0x7fbc2013f2b0 2024-03-08T21:34:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc1f400640 1 --2- 172.21.15.119:0/3822125159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc2013f2b0 0x7fbc200b3820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc200732a0 tx=0x7fbc1801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5ace4973d0a41a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc1d600640 1 -- 172.21.15.119:0/3822125159 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180b0070 con 0x7fbc2013f2b0 2024-03-08T21:34:59.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc1d600640 1 -- 172.21.15.119:0/3822125159 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc180ab600 con 0x7fbc2013f2b0 2024-03-08T21:34:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc1d600640 1 -- 172.21.15.119:0/3822125159 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180ab9d0 con 0x7fbc2013f2b0 2024-03-08T21:34:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 -- 172.21.15.119:0/3822125159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc2013f2b0 msgr2=0x7fbc200b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 --2- 172.21.15.119:0/3822125159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc2013f2b0 0x7fbc200b3820 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc200732a0 tx=0x7fbc1801c520 comp rx=0 tx=0).stop 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 -- 172.21.15.119:0/3822125159 shutdown_connections 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 --2- 172.21.15.119:0/3822125159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc2013f2b0 0x7fbc200b3820 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 --2- 172.21.15.119:0/3822125159 >> v2:172.21.15.160:3300/0 conn(0x7fbc200b4410 0x7fbc200b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 -- 172.21.15.119:0/3822125159 >> 172.21.15.119:0/3822125159 conn(0x7fbc2006b6e0 msgr2=0x7fbc200ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 -- 172.21.15.119:0/3822125159 shutdown_connections 2024-03-08T21:34:59.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.604+0000 7fbc25800640 1 -- 172.21.15.119:0/3822125159 wait complete. 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 Processor -- start 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- start start 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc200b47f0 0x7fbc20131830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc2013f2b0 0x7fbc20131d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20152080 con 0x7fbc200b4410 2024-03-08T21:34:59.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20152200 con 0x7fbc2013f2b0 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc20152380 con 0x7fbc200b47f0 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60624/0 (socket says 172.21.15.119:60624) 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 -- 172.21.15.119:0/1556339293 learned_addr learned my addr 172.21.15.119:0/1556339293 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1e000640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc200b47f0 0x7fbc20131830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1f400640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc2013f2b0 0x7fbc20131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 -- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc200b47f0 msgr2=0x7fbc20131830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc200b47f0 0x7fbc20131830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 -- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc2013f2b0 msgr2=0x7fbc20131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc2013f2b0 0x7fbc20131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 -- 172.21.15.119:0/1556339293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20139080 con 0x7fbc200b4410 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc1ea00640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dd0 tx=0x7fbc1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10018020 con 0x7fbc200b4410 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10014480 con 0x7fbc200b4410 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10014870 con 0x7fbc200b4410 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc20133810 con 0x7fbc200b4410 2024-03-08T21:34:59.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc20140e10 con 0x7fbc200b4410 2024-03-08T21:34:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.608+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc20067db0 con 0x7fbc200b4410 2024-03-08T21:34:59.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.612+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fbc1001b020 con 0x7fbc200b4410 2024-03-08T21:34:59.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.612+0000 7fbc16a00640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 0x7fbc00069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.612+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc10086420 con 0x7fbc200b4410 2024-03-08T21:34:59.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.612+0000 7fbc1e000640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 0x7fbc00069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.612+0000 7fbc1e000640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 0x7fbc00069b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc20142a50 tx=0x7fbc0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.616+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fbc10022030 con 0x7fbc200b4410 2024-03-08T21:34:59.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.784+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc20143c80 con 0x7fbc00067660 2024-03-08T21:34:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.784+0000 7fbc16a00640 1 -- 172.21.15.119:0/1556339293 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc20143c80 con 0x7fbc00067660 2024-03-08T21:34:59.775 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 5 to deep-scrub 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 msgr2=0x7fbc00069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 0x7fbc00069b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc20142a50 tx=0x7fbc0c009040 comp rx=0 tx=0).stop 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 msgr2=0x7fbc201417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dd0 tx=0x7fbc1000c490 comp rx=0 tx=0).stop 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 shutdown_connections 2024-03-08T21:34:59.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fbc00067660 0x7fbc00069b20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc2013f2b0 0x7fbc20131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc200b47f0 0x7fbc20131830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 --2- 172.21.15.119:0/1556339293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc200b4410 0x7fbc201417f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 >> 172.21.15.119:0/1556339293 conn(0x7fbc2006b6e0 msgr2=0x7fbc20142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 shutdown_connections 2024-03-08T21:34:59.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.788+0000 7fbc25800640 1 -- 172.21.15.119:0/1556339293 wait complete. 2024-03-08T21:34:59.795 INFO:tasks.ceph:Scrubbing osd.6 2024-03-08T21:34:59.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:34:59.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 Processor -- start 2024-03-08T21:34:59.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 -- start start 2024-03-08T21:34:59.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f1406c840 0x7f5f140b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5f14140fb0 0x7f5f141413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1406cc20 con 0x7f5f14144030 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140b3670 con 0x7f5f1406c840 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f1a600640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140b3950 con 0x7f5f14140fb0 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f1406c840 0x7f5f140b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5f1406c840 0x7f5f140b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60632/0 (socket says 172.21.15.119:60632) 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 -- 172.21.15.119:0/3916475856 learned_addr learned my addr 172.21.15.119:0/3916475856 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13e00640 1 --2- 172.21.15.119:0/3916475856 >> v2:172.21.15.160:3300/0 conn(0x7f5f14140fb0 0x7f5f141413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 -- 172.21.15.119:0/3916475856 >> v2:172.21.15.160:3300/0 conn(0x7f5f14140fb0 msgr2=0x7f5f141413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 --2- 172.21.15.119:0/3916475856 >> v2:172.21.15.160:3300/0 conn(0x7f5f14140fb0 0x7f5f141413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 -- 172.21.15.119:0/3916475856 >> v1:172.21.15.160:6789/0 conn(0x7f5f14144030 legacy=0x7f5f141444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:34:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.944+0000 7f5f13400640 1 -- 172.21.15.119:0/3916475856 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140b3c30 con 0x7f5f1406c840 2024-03-08T21:34:59.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f13400640 1 --2- 172.21.15.119:0/3916475856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f1406c840 0x7f5f140b3090 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f14073540 tx=0x7f5f0401eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ac3431ec7f7505 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f12a00640 1 -- 172.21.15.119:0/3916475856 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400b2d0 con 0x7f5f1406c840 2024-03-08T21:34:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f12a00640 1 -- 172.21.15.119:0/3916475856 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400b470 con 0x7f5f1406c840 2024-03-08T21:34:59.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f12a00640 1 -- 172.21.15.119:0/3916475856 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f040a7b20 con 0x7f5f1406c840 2024-03-08T21:34:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 -- 172.21.15.119:0/3916475856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f1406c840 msgr2=0x7f5f140b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 --2- 172.21.15.119:0/3916475856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f1406c840 0x7f5f140b3090 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f14073540 tx=0x7f5f0401eb20 comp rx=0 tx=0).stop 2024-03-08T21:34:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 -- 172.21.15.119:0/3916475856 shutdown_connections 2024-03-08T21:34:59.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 --2- 172.21.15.119:0/3916475856 >> v2:172.21.15.160:3300/0 conn(0x7f5f14140fb0 0x7f5f141413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 --2- 172.21.15.119:0/3916475856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f1406c840 0x7f5f140b3090 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 -- 172.21.15.119:0/3916475856 >> 172.21.15.119:0/3916475856 conn(0x7f5f1409a230 msgr2=0x7f5f1409a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 -- 172.21.15.119:0/3916475856 shutdown_connections 2024-03-08T21:34:59.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.948+0000 7f5f1a600640 1 -- 172.21.15.119:0/3916475856 wait complete. 2024-03-08T21:34:59.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 Processor -- start 2024-03-08T21:34:59.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- start start 2024-03-08T21:34:59.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f1406c840 0x7f5f140b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 0x7f5f140716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f14144030 0x7f5f1414d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1406da50 con 0x7f5f14140fb0 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1406d8d0 con 0x7f5f14144030 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1406dbd0 con 0x7f5f1406c840 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 0x7f5f140716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 0x7f5f140716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60640/0 (socket says 172.21.15.119:60640) 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 -- 172.21.15.119:0/1616435222 learned_addr learned my addr 172.21.15.119:0/1616435222 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:34:59.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f13400640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f1406c840 0x7f5f140b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f13e00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f14144030 0x7f5f1414d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 -- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f1406c840 msgr2=0x7f5f140b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f1406c840 0x7f5f140b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 -- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f14144030 msgr2=0x7f5f1414d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f14144030 0x7f5f1414d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14072a80 con 0x7f5f14140fb0 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0aa00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 0x7f5f140716f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00b410 tx=0x7f5efc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc015030 con 0x7f5f14140fb0 2024-03-08T21:34:59.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc004020 con 0x7f5f14140fb0 2024-03-08T21:34:59.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f14070e00 con 0x7f5f14140fb0 2024-03-08T21:34:59.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc004450 con 0x7f5f14140fb0 2024-03-08T21:34:59.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140711d0 con 0x7f5f14140fb0 2024-03-08T21:34:59.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.952+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f14070ba0 con 0x7f5f14140fb0 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f5efc018070 con 0x7f5f14140fb0 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ef0067660 0x7f5ef0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5efc0858e0 con 0x7f5f14140fb0 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f13400640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ef0067660 0x7f5ef0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5ef006d520 0x7f5ef006f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5efc006780 con 0x7f5ef006d520 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5efc085c90 con 0x7f5f14140fb0 2024-03-08T21:34:59.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f13e00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5ef006d520 0x7f5ef006f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:34:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f13400640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ef0067660 0x7f5ef0069b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f040b0000 tx=0x7f5f040a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f13e00640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5ef006d520 0x7f5ef006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:34:59.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.956+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== osd.6 v2:172.21.15.160:6824/2462175977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5efc006780 con 0x7f5ef006d520 2024-03-08T21:34:59.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 --> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f14067db0 con 0x7f5ef006d520 2024-03-08T21:34:59.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f0be00640 1 -- 172.21.15.119:0/1616435222 <== osd.6 v2:172.21.15.160:6824/2462175977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f14067db0 con 0x7f5ef006d520 2024-03-08T21:34:59.960 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:34:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:34:59.961 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5ef006d520 msgr2=0x7f5ef006f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.160:6824/2462175977,v1:172.21.15.160:6825/2462175977] conn(0x7f5ef006d520 0x7f5ef006f940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ef0067660 msgr2=0x7f5ef0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f5ef0067660 0x7f5ef0069b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5f040b0000 tx=0x7f5f040a9070 comp rx=0 tx=0).stop 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 msgr2=0x7f5f140716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 --2- 172.21.15.119:0/1616435222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f14140fb0 0x7f5f140716f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00b410 tx=0x7f5efc00b8d0 comp rx=0 tx=0).stop 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f13e00640 1 -- 172.21.15.119:0/1616435222 reap_dead start 2024-03-08T21:34:59.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 shutdown_connections 2024-03-08T21:34:59.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 >> 172.21.15.119:0/1616435222 conn(0x7f5f1409a230 msgr2=0x7f5f140b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:34:59.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 shutdown_connections 2024-03-08T21:34:59.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:34:59.972+0000 7f5f1a600640 1 -- 172.21.15.119:0/1616435222 wait complete. 2024-03-08T21:34:59.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-08T21:35:00.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.124+0000 7f1bca000640 1 Processor -- start 2024-03-08T21:35:00.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 -- start start 2024-03-08T21:35:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bc40bb020 0x7f1bc406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc4072b60 0x7f1bc40b9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40bb400 con 0x7f1bc4073040 2024-03-08T21:35:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40b8da0 con 0x7f1bc40bb020 2024-03-08T21:35:00.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bca000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40b99c0 con 0x7f1bc4072b60 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bc40bb020 0x7f1bc406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bc40bb020 0x7f1bc406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60646/0 (socket says 172.21.15.119:60646) 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 -- 172.21.15.119:0/1297225193 learned_addr learned my addr 172.21.15.119:0/1297225193 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bbbe00640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc4072b60 0x7f1bc40b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 -- 172.21.15.119:0/1297225193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc4072b60 msgr2=0x7f1bc40b9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc4072b60 0x7f1bc40b9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 -- 172.21.15.119:0/1297225193 >> v1:172.21.15.119:6789/0 conn(0x7f1bc4073040 legacy=0x7f1bc413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc2a00640 1 -- 172.21.15.119:0/1297225193 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854313143 0 0) 0x7f1bc40bb400 con 0x7f1bc4073040 2024-03-08T21:35:00.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.128+0000 7f1bc3400640 1 -- 172.21.15.119:0/1297225193 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc406e8c0 con 0x7f1bc40bb020 2024-03-08T21:35:00.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bc3400640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc40bb020 0x7f1bc406f8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a5311d35e3a76d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bc2a00640 1 -- 172.21.15.119:0/1297225193 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40a9640 con 0x7f1bc40bb020 2024-03-08T21:35:00.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bc2a00640 1 -- 172.21.15.119:0/1297225193 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40a97e0 con 0x7f1bc40bb020 2024-03-08T21:35:00.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bc2a00640 1 -- 172.21.15.119:0/1297225193 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40a9bb0 con 0x7f1bc40bb020 2024-03-08T21:35:00.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 -- 172.21.15.119:0/1297225193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc40bb020 msgr2=0x7f1bc406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc40bb020 0x7f1bc406f8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb401c560 comp rx=0 tx=0).stop 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 -- 172.21.15.119:0/1297225193 shutdown_connections 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc4072b60 0x7f1bc40b9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 --2- 172.21.15.119:0/1297225193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc40bb020 0x7f1bc406f8d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 -- 172.21.15.119:0/1297225193 >> 172.21.15.119:0/1297225193 conn(0x7f1bc4099a40 msgr2=0x7f1bc40ba6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 -- 172.21.15.119:0/1297225193 shutdown_connections 2024-03-08T21:35:00.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 -- 172.21.15.119:0/1297225193 wait complete. 2024-03-08T21:35:00.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.132+0000 7f1bca000640 1 Processor -- start 2024-03-08T21:35:00.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- start start 2024-03-08T21:35:00.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bc4072b60 0x7f1bc4140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc40bb020 0x7f1bc41ddbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc41521d0 con 0x7f1bc4073040 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4152050 con 0x7f1bc4072b60 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4152350 con 0x7f1bc40bb020 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60650/0 (socket says 172.21.15.119:60650) 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 -- 172.21.15.119:0/3017361680 learned_addr learned my addr 172.21.15.119:0/3017361680 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bc3e00640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc40bb020 0x7f1bc41ddbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bc3400640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bc4072b60 0x7f1bc4140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 -- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc40bb020 msgr2=0x7f1bc41ddbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc40bb020 0x7f1bc41ddbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 -- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bc4072b60 msgr2=0x7f1bc4140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bc4072b60 0x7f1bc4140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 -- 172.21.15.119:0/3017361680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4142300 con 0x7f1bc4073040 2024-03-08T21:35:00.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbbe00640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e960 tx=0x7f1bac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac017070 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00ca00 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00cdb0 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc409e870 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc4141060 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.136+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4140e70 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.140+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f1bac01a070 con 0x7f1bc4073040 2024-03-08T21:35:00.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.140+0000 7f1bbb400640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 0x7f1ba0069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.140+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1bac0855f0 con 0x7f1bc4073040 2024-03-08T21:35:00.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.140+0000 7f1bc3400640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 0x7f1ba0069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.140+0000 7f1bc3400640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 0x7f1ba0069b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ae000 tx=0x7f1bb40b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.144+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f1bac055e80 con 0x7f1bc4073040 2024-03-08T21:35:00.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.300+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bc4067db0 con 0x7f1ba0067660 2024-03-08T21:35:00.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.300+0000 7f1bbb400640 1 -- 172.21.15.119:0/3017361680 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1bc4067db0 con 0x7f1ba0067660 2024-03-08T21:35:00.291 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 6 to deep-scrub 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 msgr2=0x7f1ba0069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 0x7f1ba0069b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ae000 tx=0x7f1bb40b3040 comp rx=0 tx=0).stop 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 msgr2=0x7f1bc41dd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e960 tx=0x7f1bac00ee20 comp rx=0 tx=0).stop 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 shutdown_connections 2024-03-08T21:35:00.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f1ba0067660 0x7f1ba0069b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1bc40bb020 0x7f1bc41ddbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc4073040 0x7f1bc41dd670 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 --2- 172.21.15.119:0/3017361680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bc4072b60 0x7f1bc4140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 >> 172.21.15.119:0/3017361680 conn(0x7f1bc4099a40 msgr2=0x7f1bc413eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 shutdown_connections 2024-03-08T21:35:00.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.304+0000 7f1bca000640 1 -- 172.21.15.119:0/3017361680 wait complete. 2024-03-08T21:35:00.312 INFO:tasks.ceph:Scrubbing osd.7 2024-03-08T21:35:00.312 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-08T21:35:00.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 Processor -- start 2024-03-08T21:35:00.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 -- start start 2024-03-08T21:35:00.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 0x7f3484152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348406edd0 con 0x7f34840b4740 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840b4b20 con 0x7f348406be60 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f348a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34841471d0 con 0x7f3484150800 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f34840b4740 0x7f3484140be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42562/0 (socket says 172.21.15.119:42562) 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483400640 1 -- 172.21.15.119:0/3216298442 learned_addr learned my addr 172.21.15.119:0/3216298442 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483e00640 1 --2- 172.21.15.119:0/3216298442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 0x7f3484152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013908326 0 0) 0x7f3474001120 con 0x7f34840b4740 2024-03-08T21:35:00.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3468003530 con 0x7f34840b4740 2024-03-08T21:35:00.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639219024 0 0) 0x7f34840b4b20 con 0x7f348406be60 2024-03-08T21:35:00.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3474001120 con 0x7f348406be60 2024-03-08T21:35:00.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483e00640 1 -- 172.21.15.119:0/3216298442 >> v1:172.21.15.160:6789/0 conn(0x7f348406be60 legacy=0x7f3484147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483e00640 1 -- 172.21.15.119:0/3216298442 >> v1:172.21.15.119:6789/0 conn(0x7f34840b4740 legacy=0x7f3484140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.464+0000 7f3483e00640 1 -- 172.21.15.119:0/3216298442 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484146e80 con 0x7f3484150800 2024-03-08T21:35:00.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f3483e00640 1 --2- 172.21.15.119:0/3216298442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 0x7f3484152bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f347c009dc0 tx=0x7f347c01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4a6913174adbfa server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0b2070 con 0x7f3484150800 2024-03-08T21:35:00.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c0a57c0 con 0x7f3484150800 2024-03-08T21:35:00.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f3482a00640 1 -- 172.21.15.119:0/3216298442 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0a5b90 con 0x7f3484150800 2024-03-08T21:35:00.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 -- 172.21.15.119:0/3216298442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 msgr2=0x7f3484152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 --2- 172.21.15.119:0/3216298442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 0x7f3484152bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f347c009dc0 tx=0x7f347c01c900 comp rx=0 tx=0).stop 2024-03-08T21:35:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 -- 172.21.15.119:0/3216298442 shutdown_connections 2024-03-08T21:35:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 --2- 172.21.15.119:0/3216298442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3484150800 0x7f3484152bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 -- 172.21.15.119:0/3216298442 >> 172.21.15.119:0/3216298442 conn(0x7f34840ba730 msgr2=0x7f34840bab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 -- 172.21.15.119:0/3216298442 shutdown_connections 2024-03-08T21:35:00.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 -- 172.21.15.119:0/3216298442 wait complete. 2024-03-08T21:35:00.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.468+0000 7f348a800640 1 Processor -- start 2024-03-08T21:35:00.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- start start 2024-03-08T21:35:00.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f348406be60 0x7f34840b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34840b4740 0x7f3484141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 0x7f3484141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348406d830 con 0x7f3484150800 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484147d70 con 0x7f34840b4740 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348406d9b0 con 0x7f348406be60 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 0x7f3484141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f348406be60 0x7f34840b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 0x7f3484141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60656/0 (socket says 172.21.15.119:60656) 2024-03-08T21:35:00.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 -- 172.21.15.119:0/1069341233 learned_addr learned my addr 172.21.15.119:0/1069341233 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f347be00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34840b4740 0x7f3484141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 -- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f348406be60 msgr2=0x7f34840b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f348406be60 0x7f34840b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 -- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34840b4740 msgr2=0x7f3484141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34840b4740 0x7f3484141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34841432d0 con 0x7f3484150800 2024-03-08T21:35:00.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f3483e00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 0x7f3484141cb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f347c01a530 tx=0x7f347c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0b2050 con 0x7f3484150800 2024-03-08T21:35:00.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c0be070 con 0x7f3484150800 2024-03-08T21:35:00.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c009450 con 0x7f3484150800 2024-03-08T21:35:00.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34841435b0 con 0x7f3484150800 2024-03-08T21:35:00.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3484143d20 con 0x7f3484150800 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.472+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3484067db0 con 0x7f3484150800 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f347c0ad890 con 0x7f3484150800 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3460067690 0x7f3460069b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f347c120cf0 con 0x7f3484150800 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f3483400640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3460067690 0x7f3460069b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7f346006d550 0x7f346006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f347c0c5e70 con 0x7f346006d550 2024-03-08T21:35:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f347c1210a0 con 0x7f3484150800 2024-03-08T21:35:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347be00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7f346006d550 0x7f346006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f3483400640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3460067690 0x7f3460069b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3474007fd0 tx=0x7f3474007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347be00640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7f346006d550 0x7f346006f970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.476+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== osd.7 v2:172.21.15.160:6808/1919516380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f347c0c5e70 con 0x7f346006d550 2024-03-08T21:35:00.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 --> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34840b1910 con 0x7f346006d550 2024-03-08T21:35:00.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f347b400640 1 -- 172.21.15.119:0/1069341233 <== osd.7 v2:172.21.15.160:6808/1919516380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f34840b1910 con 0x7f346006d550 2024-03-08T21:35:00.481 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-03-08T21:35:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T21:35:00.481 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-03-08T21:35:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7f346006d550 msgr2=0x7f346006f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.160:6808/1919516380,v1:172.21.15.160:6809/1919516380] conn(0x7f346006d550 0x7f346006f970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3460067690 msgr2=0x7f3460069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f3460067690 0x7f3460069b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3474007fd0 tx=0x7f3474007d80 comp rx=0 tx=0).stop 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 msgr2=0x7f3484141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 --2- 172.21.15.119:0/1069341233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3484150800 0x7f3484141cb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f347c01a530 tx=0x7f347c0196a0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f3483e00640 1 -- 172.21.15.119:0/1069341233 reap_dead start 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 shutdown_connections 2024-03-08T21:35:00.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 >> 172.21.15.119:0/1069341233 conn(0x7f34840ba730 msgr2=0x7f3484146660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 shutdown_connections 2024-03-08T21:35:00.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.492+0000 7f348a800640 1 -- 172.21.15.119:0/1069341233 wait complete. 2024-03-08T21:35:00.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-08T21:35:00.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 Processor -- start 2024-03-08T21:35:00.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 -- start start 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 0x7fb41809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4181448b0 0x7fb41813d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41809b190 con 0x7fb418072fe0 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41809d240 con 0x7fb4181448b0 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41fc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41809d520 con 0x7fb41809adb0 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb417e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb418072fe0 0x7fb4181441a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:42574/0 (socket says 172.21.15.119:42574) 2024-03-08T21:35:00.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb417e00640 1 -- 172.21.15.119:0/668973340 learned_addr learned my addr 172.21.15.119:0/668973340 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41d200640 1 --2- 172.21.15.119:0/668973340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 0x7fb41809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41dc00640 1 --2- 172.21.15.119:0/668973340 >> v2:172.21.15.160:3300/0 conn(0x7fb4181448b0 0x7fb41813d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb417400640 1 -- 172.21.15.119:0/668973340 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786109441 0 0) 0x7fb41809b190 con 0x7fb418072fe0 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb417400640 1 -- 172.21.15.119:0/668973340 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb400003530 con 0x7fb418072fe0 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41d200640 1 -- 172.21.15.119:0/668973340 >> v2:172.21.15.160:3300/0 conn(0x7fb4181448b0 msgr2=0x7fb41813d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41d200640 1 --2- 172.21.15.119:0/668973340 >> v2:172.21.15.160:3300/0 conn(0x7fb4181448b0 0x7fb41813d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41d200640 1 -- 172.21.15.119:0/668973340 >> v1:172.21.15.119:6789/0 conn(0x7fb418072fe0 legacy=0x7fb4181441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.644+0000 7fb41d200640 1 -- 172.21.15.119:0/668973340 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418143c50 con 0x7fb41809adb0 2024-03-08T21:35:00.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.648+0000 7fb41d200640 1 --2- 172.21.15.119:0/668973340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 0x7fb41809cbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0097c0 tx=0x7fb40c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3794c60cb25aa312 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb417400640 1 -- 172.21.15.119:0/668973340 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c0b2070 con 0x7fb41809adb0 2024-03-08T21:35:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb417400640 1 -- 172.21.15.119:0/668973340 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c0a9070 con 0x7fb41809adb0 2024-03-08T21:35:00.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb417400640 1 -- 172.21.15.119:0/668973340 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c0ad880 con 0x7fb41809adb0 2024-03-08T21:35:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- 172.21.15.119:0/668973340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 msgr2=0x7fb41809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 --2- 172.21.15.119:0/668973340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 0x7fb41809cbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0097c0 tx=0x7fb40c01c4a0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- 172.21.15.119:0/668973340 shutdown_connections 2024-03-08T21:35:00.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 --2- 172.21.15.119:0/668973340 >> v2:172.21.15.160:3300/0 conn(0x7fb4181448b0 0x7fb41813d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 --2- 172.21.15.119:0/668973340 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb41809adb0 0x7fb41809cbf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- 172.21.15.119:0/668973340 >> 172.21.15.119:0/668973340 conn(0x7fb41806c620 msgr2=0x7fb41806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- 172.21.15.119:0/668973340 shutdown_connections 2024-03-08T21:35:00.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- 172.21.15.119:0/668973340 wait complete. 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 Processor -- start 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.652+0000 7fb41fc00640 1 -- start start 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb418072fe0 0x7fb4180b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4181448b0 0x7fb4180b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41809a5e0 con 0x7fb41809adb0 2024-03-08T21:35:00.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41809a460 con 0x7fb418072fe0 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41809a760 con 0x7fb4181448b0 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60672/0 (socket says 172.21.15.119:60672) 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 -- 172.21.15.119:0/1763836242 learned_addr learned my addr 172.21.15.119:0/1763836242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41d200640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb418072fe0 0x7fb4180b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41dc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4181448b0 0x7fb4180b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 -- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4181448b0 msgr2=0x7fb4180b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4181448b0 0x7fb4180b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 -- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb418072fe0 msgr2=0x7fb4180b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb418072fe0 0x7fb4180b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 -- 172.21.15.119:0/1763836242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180b0f30 con 0x7fb41809adb0 2024-03-08T21:35:00.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb417e00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c420 tx=0x7fb40400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404017070 con 0x7fb41809adb0 2024-03-08T21:35:00.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404005d10 con 0x7fb41809adb0 2024-03-08T21:35:00.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404007310 con 0x7fb41809adb0 2024-03-08T21:35:00.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180b1210 con 0x7fb41809adb0 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418071590 con 0x7fb41809adb0 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb418067db0 con 0x7fb41809adb0 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.656+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fb40401a070 con 0x7fb41809adb0 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.660+0000 7fb414c00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 0x7fb3f8069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.660+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb4040848f0 con 0x7fb41809adb0 2024-03-08T21:35:00.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.660+0000 7fb41d200640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 0x7fb3f8069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.660+0000 7fb41d200640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 0x7fb3f8069b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0af000 tx=0x7fb40c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.664+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fb404055370 con 0x7fb41809adb0 2024-03-08T21:35:00.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.816+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb41813ca20 con 0x7fb3f8067660 2024-03-08T21:35:00.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.816+0000 7fb414c00640 1 -- 172.21.15.119:0/1763836242 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb41813ca20 con 0x7fb3f8067660 2024-03-08T21:35:00.807 INFO:teuthology.orchestra.run.smithi119.stderr:instructed osd(s) 7 to deep-scrub 2024-03-08T21:35:00.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 msgr2=0x7fb3f8069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 0x7fb3f8069b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0af000 tx=0x7fb40c008040 comp rx=0 tx=0).stop 2024-03-08T21:35:00.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 msgr2=0x7fb418140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c420 tx=0x7fb40400c8e0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 shutdown_connections 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fb3f8067660 0x7fb3f8069b20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4181448b0 0x7fb4180b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41809adb0 0x7fb418140d50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 --2- 172.21.15.119:0/1763836242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb418072fe0 0x7fb4180b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 >> 172.21.15.119:0/1763836242 conn(0x7fb41806c620 msgr2=0x7fb4180b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 shutdown_connections 2024-03-08T21:35:00.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.820+0000 7fb41fc00640 1 -- 172.21.15.119:0/1763836242 wait complete. 2024-03-08T21:35:00.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:35:00.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 Processor -- start 2024-03-08T21:35:00.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 -- start start 2024-03-08T21:35:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd2501448b0 0x7fd25013d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25009b190 con 0x7fd250072fe0 2024-03-08T21:35:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25009d240 con 0x7fd2501448b0 2024-03-08T21:35:00.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.972+0000 7fd255200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25009d520 con 0x7fd25009adb0 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.119:36252/0 (socket says 172.21.15.119:36252) 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 -- 172.21.15.119:0/582153306 learned_addr learned my addr 172.21.15.119:0/582153306 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24e800640 1 --2- 172.21.15.119:0/582153306 >> v2:172.21.15.160:3300/0 conn(0x7fd2501448b0 0x7fd25013d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 -- 172.21.15.119:0/582153306 >> v2:172.21.15.160:3300/0 conn(0x7fd2501448b0 msgr2=0x7fd25013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 --2- 172.21.15.119:0/582153306 >> v2:172.21.15.160:3300/0 conn(0x7fd2501448b0 0x7fd25013d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 -- 172.21.15.119:0/582153306 >> v1:172.21.15.160:6789/0 conn(0x7fd250072fe0 legacy=0x7fd2501441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 -- 172.21.15.119:0/582153306 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250143c50 con 0x7fd25009adb0 2024-03-08T21:35:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24de00640 1 --2- 172.21.15.119:0/582153306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd240009870 tx=0x7fd24001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3afa1e1109e57aa server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24d400640 1 -- 172.21.15.119:0/582153306 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400aa680 con 0x7fd25009adb0 2024-03-08T21:35:00.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24d400640 1 -- 172.21.15.119:0/582153306 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400af070 con 0x7fd25009adb0 2024-03-08T21:35:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.976+0000 7fd24d400640 1 -- 172.21.15.119:0/582153306 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400aaa40 con 0x7fd25009adb0 2024-03-08T21:35:00.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- 172.21.15.119:0/582153306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 msgr2=0x7fd25009cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- 172.21.15.119:0/582153306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd240009870 tx=0x7fd24001c560 comp rx=0 tx=0).stop 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- 172.21.15.119:0/582153306 shutdown_connections 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- 172.21.15.119:0/582153306 >> v2:172.21.15.160:3300/0 conn(0x7fd2501448b0 0x7fd25013d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- 172.21.15.119:0/582153306 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd25009adb0 0x7fd25009cbf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- 172.21.15.119:0/582153306 >> 172.21.15.119:0/582153306 conn(0x7fd25006c620 msgr2=0x7fd25006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- 172.21.15.119:0/582153306 shutdown_connections 2024-03-08T21:35:00.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- 172.21.15.119:0/582153306 wait complete. 2024-03-08T21:35:00.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 Processor -- start 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- start start 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 0x7fd2500b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 0x7fd2501385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250151180 con 0x7fd25009adb0 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd250151000 con 0x7fd2501448b0 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd255200640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd250151300 con 0x7fd250072fe0 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:60684/0 (socket says 172.21.15.119:60684) 2024-03-08T21:35:00.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd24de00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 0x7fd2500b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 -- 172.21.15.119:0/1698617793 learned_addr learned my addr 172.21.15.119:0/1698617793 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:00.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd24e800640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 0x7fd2501385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 -- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 msgr2=0x7fd2500b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 0x7fd2500b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 -- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 msgr2=0x7fd2501385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 0x7fd2501385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 -- 172.21.15.119:0/1698617793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500b0690 con 0x7fd25009adb0 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd24de00640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 0x7fd2500b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd24e800640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 0x7fd2501385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd245400640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c430 tx=0x7fd23800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.980+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380052d0 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd238005470 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2500b27f0 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238007260 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2500af920 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2501dd880 con 0x7fd25009adb0 2024-03-08T21:35:00.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fd238007400 con 0x7fd25009adb0 2024-03-08T21:35:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd246a00640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 0x7fd22c069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd238084970 con 0x7fd25009adb0 2024-03-08T21:35:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd24de00640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 0x7fd22c069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:00.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.984+0000 7fd24de00640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 0x7fd22c069b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2400ae000 tx=0x7fd2400a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:00.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:00.988+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fd238055330 con 0x7fd25009adb0 2024-03-08T21:35:01.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.140+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd250067db0 con 0x7fd22c067660 2024-03-08T21:35:01.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.140+0000 7fd246a00640 1 -- 172.21.15.119:0/1698617793 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13438 (secure 0 0 0) 0x7fd250067db0 con 0x7fd22c067660 2024-03-08T21:35:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:35:01.131 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:35:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 msgr2=0x7fd22c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 0x7fd22c069b20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2400ae000 tx=0x7fd2400a7000 comp rx=0 tx=0).stop 2024-03-08T21:35:01.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 msgr2=0x7fd2501ddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c430 tx=0x7fd23800c8f0 comp rx=0 tx=0).stop 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 shutdown_connections 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fd22c067660 0x7fd22c069b20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2501448b0 0x7fd2501385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd25009adb0 0x7fd2501ddf90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 --2- 172.21.15.119:0/1698617793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd250072fe0 0x7fd2500b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 >> 172.21.15.119:0/1698617793 conn(0x7fd25006c620 msgr2=0x7fd250073e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:01.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 shutdown_connections 2024-03-08T21:35:01.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:01.144+0000 7fd255200640 1 -- 172.21.15.119:0/1698617793 wait complete. 2024-03-08T21:35:01.151 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-08T21:35:00.428904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224416,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750304,"statfs":{"total":773094113280,"available":772864311296,"internally_reserved":0,"allocated":4169728,"data_stored":2324048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.805841"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-08T21:34:52.636936+0000","last_change":"2024-03-08T21:33:36.476913+0000","last_active":"2024-03-08T21:34:52.636936+0000","last_peered":"2024-03-08T21:34:52.636936+0000","last_clean":"2024-03-08T21:34:52.636936+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:34:52.636936+0000","last_undegraded":"2024-03-08T21:34:52.636936+0000","last_fullsized":"2024-03-08T21:34:52.636936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T21:33:35.224359+0000","last_clean_scrub_stamp":"2024-03-08T21:33:35.224359+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T06:20:04.018695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":966656,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:35:01.153 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-08T21:33:35.224359+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=21, tm_min=33, tm_sec=35, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=21, tm_min=34, tm_sec=55, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T21:35:01.153 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-08T21:35:17.875 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:17.879 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:21.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T21:35:21.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.307+0000 7fa200800640 1 Processor -- start 2024-03-08T21:35:21.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.307+0000 7fa200800640 1 -- start start 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa200800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f8099ca0 0x7fa1f813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa200800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1f813f2c0 0x7fa1f809a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa200800640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f809a080 con 0x7fa1f809ae10 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa200800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f80b4b60 con 0x7fa1f813f2c0 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa200800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80b4510 con 0x7fa1f8099ca0 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1f813f2c0 0x7fa1f809a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1f813f2c0 0x7fa1f809a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50384/0 (socket says 172.21.15.119:50384) 2024-03-08T21:35:21.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 -- 172.21.15.119:0/1444207329 learned_addr learned my addr 172.21.15.119:0/1444207329 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fde00640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f8099ca0 0x7fa1f813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 -- 172.21.15.119:0/1444207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f8099ca0 msgr2=0x7fa1f813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f8099ca0 0x7fa1f813ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 -- 172.21.15.119:0/1444207329 >> v1:172.21.15.160:6789/0 conn(0x7fa1f809ae10 legacy=0x7fa1f80b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.311+0000 7fa1fd400640 1 -- 172.21.15.119:0/1444207329 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80b47f0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fd400640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f809a8d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009870 tx=0x7fa1e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3892d178fba2354e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fca00640 1 -- 172.21.15.119:0/1444207329 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80a7070 con 0x7fa1f813f2c0 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fca00640 1 -- 172.21.15.119:0/1444207329 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e80b0070 con 0x7fa1f813f2c0 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fca00640 1 -- 172.21.15.119:0/1444207329 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80ab890 con 0x7fa1f813f2c0 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- 172.21.15.119:0/1444207329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 msgr2=0x7fa1f809a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f809a8d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009870 tx=0x7fa1e801c520 comp rx=0 tx=0).stop 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- 172.21.15.119:0/1444207329 shutdown_connections 2024-03-08T21:35:21.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f809a8d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- 172.21.15.119:0/1444207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f8099ca0 0x7fa1f813ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- 172.21.15.119:0/1444207329 >> 172.21.15.119:0/1444207329 conn(0x7fa1f806c620 msgr2=0x7fa1f806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:21.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- 172.21.15.119:0/1444207329 shutdown_connections 2024-03-08T21:35:21.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- 172.21.15.119:0/1444207329 wait complete. 2024-03-08T21:35:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 Processor -- start 2024-03-08T21:35:21.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- start start 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f8099ca0 0x7fa1f809c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f809ae10 0x7fa1f8144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f81522d0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8152150 con 0x7fa1f8099ca0 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa200800640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8152450 con 0x7fa1f809ae10 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fe800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fe800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50390/0 (socket says 172.21.15.119:50390) 2024-03-08T21:35:21.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fe800640 1 -- 172.21.15.119:0/1742454321 learned_addr learned my addr 172.21.15.119:0/1742454321 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fd400640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f809ae10 0x7fa1f8144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.315+0000 7fa1fde00640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f8099ca0 0x7fa1f809c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 -- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f809ae10 msgr2=0x7fa1f8144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f809ae10 0x7fa1f8144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 -- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f8099ca0 msgr2=0x7fa1f809c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.310 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f8099ca0 0x7fa1f809c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 -- 172.21.15.119:0/1742454321 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8140fa0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fe800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c770 tx=0x7fa1f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003b80 con 0x7fa1f813f2c0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4003d20 con 0x7fa1f813f2c0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f81e0ef0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400aa30 con 0x7fa1f813f2c0 2024-03-08T21:35:21.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f81e14b0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f8067db0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7fa1f400abd0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 0x7fa1dc069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa1f4085380 con 0x7fa1f813f2c0 2024-03-08T21:35:21.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.319+0000 7fa1fde00640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 0x7fa1dc069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.323+0000 7fa1fde00640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 0x7fa1dc069b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1f813f980 tx=0x7fa1ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.327+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7fa1f4055ca0 con 0x7fa1f813f2c0 2024-03-08T21:35:21.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.475+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 --> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f81e1680 con 0x7fa1dc067660 2024-03-08T21:35:21.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa1f2000640 1 -- 172.21.15.119:0/1742454321 <== mgr.4101 v2:172.21.15.119:6832/3371077572 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13354 (secure 0 0 0) 0x7fa1f81e1680 con 0x7fa1dc067660 2024-03-08T21:35:21.468 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:35:21.469 INFO:teuthology.orchestra.run.smithi119.stderr:dumped all 2024-03-08T21:35:21.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 msgr2=0x7fa1dc069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 0x7fa1dc069b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa1f813f980 tx=0x7fa1ec009190 comp rx=0 tx=0).stop 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 msgr2=0x7fa1f8144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c770 tx=0x7fa1f400cc30 comp rx=0 tx=0).stop 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 shutdown_connections 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7fa1dc067660 0x7fa1dc069b20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1f813f2c0 0x7fa1f8144d40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f809ae10 0x7fa1f8144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 --2- 172.21.15.119:0/1742454321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f8099ca0 0x7fa1f809c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 >> 172.21.15.119:0/1742454321 conn(0x7fa1f806c620 msgr2=0x7fa1f806ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:21.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 shutdown_connections 2024-03-08T21:35:21.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.479+0000 7fa200800640 1 -- 172.21.15.119:0/1742454321 wait complete. 2024-03-08T21:35:21.489 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-03-08T21:35:20.432760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224404,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750316,"statfs":{"total":773094113280,"available":772864323584,"internally_reserved":0,"allocated":4169728,"data_stored":2324048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002267"},"pg_stats":[{"pgid":"1.0","version":"33'119","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-08T21:35:01.411725+0000","last_change":"2024-03-08T21:35:01.411750+0000","last_active":"2024-03-08T21:35:01.411725+0000","last_peered":"2024-03-08T21:35:01.411725+0000","last_clean":"2024-03-08T21:35:01.411725+0000","last_became_active":"2024-03-08T21:33:36.475453+0000","last_became_peered":"2024-03-08T21:33:36.475453+0000","last_unstale":"2024-03-08T21:35:01.411725+0000","last_undegraded":"2024-03-08T21:35:01.411725+0000","last_fullsized":"2024-03-08T21:35:01.411725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-03-08T21:35:01.411655+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-03-08T21:35:01.411655+0000","last_clean_scrub_stamp":"2024-03-08T21:35:01.411655+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T09:25:17.715384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":966656,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":142914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":966656,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T21:35:21.491 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-08T21:35:21.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 Processor -- start 2024-03-08T21:35:21.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 -- start start 2024-03-08T21:35:21.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67600b4690 0x7f67601506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676006e0b0 con 0x7f6760145b30 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6760145050 con 0x7f67600b42b0 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f6766400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6760142a90 con 0x7f67600b4690 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675ea00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6760145b30 0x7f6760142380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:49262/0 (socket says 172.21.15.119:49262) 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675ea00640 1 -- 172.21.15.119:0/3348670231 learned_addr learned my addr 172.21.15.119:0/3348670231 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675fe00640 1 --2- 172.21.15.119:0/3348670231 >> v2:172.21.15.119:3300/0 conn(0x7f67600b4690 0x7f67601506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675fe00640 1 -- 172.21.15.119:0/3348670231 >> v1:172.21.15.160:6789/0 conn(0x7f67600b42b0 legacy=0x7f676006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675fe00640 1 -- 172.21.15.119:0/3348670231 >> v1:172.21.15.119:6789/0 conn(0x7f6760145b30 legacy=0x7f6760142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675fe00640 1 -- 172.21.15.119:0/3348670231 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760145330 con 0x7f67600b4690 2024-03-08T21:35:21.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.635+0000 7f675e000640 1 -- 172.21.15.119:0/3348670231 <== mon.0 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178698884 0 0) 0x7f676006e0b0 con 0x7f6760145b30 2024-03-08T21:35:21.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f675fe00640 1 --2- 172.21.15.119:0/3348670231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67600b4690 0x7f67601506f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f67580097c0 tx=0x7f675801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb05c8a185597036 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f675e000640 1 -- 172.21.15.119:0/3348670231 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580b0070 con 0x7f67600b4690 2024-03-08T21:35:21.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f675e000640 1 -- 172.21.15.119:0/3348670231 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580ab600 con 0x7f67600b4690 2024-03-08T21:35:21.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f675e000640 1 -- 172.21.15.119:0/3348670231 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580a4e60 con 0x7f67600b4690 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- 172.21.15.119:0/3348670231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67600b4690 msgr2=0x7f67601506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 --2- 172.21.15.119:0/3348670231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67600b4690 0x7f67601506f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f67580097c0 tx=0x7f675801c3d0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- 172.21.15.119:0/3348670231 shutdown_connections 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 --2- 172.21.15.119:0/3348670231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67600b4690 0x7f67601506f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- 172.21.15.119:0/3348670231 >> 172.21.15.119:0/3348670231 conn(0x7f676009a230 msgr2=0x7f676009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:21.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- 172.21.15.119:0/3348670231 shutdown_connections 2024-03-08T21:35:21.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- 172.21.15.119:0/3348670231 wait complete. 2024-03-08T21:35:21.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 Processor -- start 2024-03-08T21:35:21.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- start start 2024-03-08T21:35:21.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67600b42b0 0x7f676014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67600b4690 0x7f67600b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760153c80 con 0x7f6760145b30 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600b3850 con 0x7f67600b42b0 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f6766400640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760153e00 con 0x7f67600b4690 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.639+0000 7f675fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50406/0 (socket says 172.21.15.119:50406) 2024-03-08T21:35:21.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 -- 172.21.15.119:0/1090949186 learned_addr learned my addr 172.21.15.119:0/1090949186 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 -- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67600b4690 msgr2=0x7f67600b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67600b4690 0x7f67600b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 -- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67600b42b0 msgr2=0x7f676014bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67600b42b0 0x7f676014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 -- 172.21.15.119:0/1090949186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676014c900 con 0x7f6760145b30 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f675fe00640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f675801a000 tx=0x7f6758019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580b8020 con 0x7f6760145b30 2024-03-08T21:35:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67580b4410 con 0x7f6760145b30 2024-03-08T21:35:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580b0040 con 0x7f6760145b30 2024-03-08T21:35:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600b1500 con 0x7f6760145b30 2024-03-08T21:35:21.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676014c620 con 0x7f6760145b30 2024-03-08T21:35:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6760067db0 con 0x7f6760145b30 2024-03-08T21:35:21.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7f67580bb020 con 0x7f6760145b30 2024-03-08T21:35:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 0x7f6740069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.643+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f675811f340 con 0x7f6760145b30 2024-03-08T21:35:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.647+0000 7f675f400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 0x7f6740069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.647+0000 7f675f400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 0x7f6740069b20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6750007fd0 tx=0x7f6750007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.651+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7f67580c2030 con 0x7f6760145b30 2024-03-08T21:35:21.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.807+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f676009da10 con 0x7f6760145b30 2024-03-08T21:35:21.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6758016050 con 0x7f6760145b30 2024-03-08T21:35:21.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6757400640 1 -- 172.21.15.119:0/1090949186 <== mon.0 v2:172.21.15.119:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f67580f02b0 con 0x7f6760145b30 2024-03-08T21:35:21.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 msgr2=0x7f6740069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 0x7f6740069b20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6750007fd0 tx=0x7f6750007d40 comp rx=0 tx=0).stop 2024-03-08T21:35:21.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 msgr2=0x7f67601dfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f675801a000 tx=0x7f6758019170 comp rx=0 tx=0).stop 2024-03-08T21:35:21.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 shutdown_connections 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7f6740067660 0x7f6740069b20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6760145b30 0x7f67601dfd90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67600b4690 0x7f67600b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 --2- 172.21.15.119:0/1090949186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67600b42b0 0x7f676014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 >> 172.21.15.119:0/1090949186 conn(0x7f676009a230 msgr2=0x7f676006c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 shutdown_connections 2024-03-08T21:35:21.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.811+0000 7f6766400640 1 -- 172.21.15.119:0/1090949186 wait complete. 2024-03-08T21:35:21.823 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T21:35:21.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T21:35:21.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 Processor -- start 2024-03-08T21:35:21.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 -- start start 2024-03-08T21:35:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 0x7ff52013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff52013f2c0 0x7ff52009a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52009a080 con 0x7ff52009ae10 2024-03-08T21:35:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52009b220 con 0x7ff52013f2c0 2024-03-08T21:35:21.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff528000640 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200b4b60 con 0x7ff520099ca0 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff52013f2c0 0x7ff52009a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff52013f2c0 0x7ff52009a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50418/0 (socket says 172.21.15.119:50418) 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 -- 172.21.15.119:0/3094300934 learned_addr learned my addr 172.21.15.119:0/3094300934 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff525600640 1 --2- 172.21.15.119:0/3094300934 >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 0x7ff52013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 -- 172.21.15.119:0/3094300934 >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 msgr2=0x7ff52013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 --2- 172.21.15.119:0/3094300934 >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 0x7ff52013ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 -- 172.21.15.119:0/3094300934 >> v1:172.21.15.160:6789/0 conn(0x7ff52009ae10 legacy=0x7ff5200b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff524c00640 1 -- 172.21.15.119:0/3094300934 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200b4510 con 0x7ff52013f2c0 2024-03-08T21:35:21.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.967+0000 7ff525600640 1 --2- 172.21.15.119:0/3094300934 >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 0x7ff52013ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T21:35:21.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff524c00640 1 --2- 172.21.15.119:0/3094300934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52013f2c0 0x7ff52009a8d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff52006e100 tx=0x7ff50c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdc0f99739b81e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff51fe00640 1 -- 172.21.15.119:0/3094300934 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0aa660 con 0x7ff52013f2c0 2024-03-08T21:35:21.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff51fe00640 1 -- 172.21.15.119:0/3094300934 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff50c0af070 con 0x7ff52013f2c0 2024-03-08T21:35:21.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff51fe00640 1 -- 172.21.15.119:0/3094300934 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0aaa40 con 0x7ff52013f2c0 2024-03-08T21:35:21.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- 172.21.15.119:0/3094300934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52013f2c0 msgr2=0x7ff52009a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 --2- 172.21.15.119:0/3094300934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52013f2c0 0x7ff52009a8d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff52006e100 tx=0x7ff50c01c4e0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- 172.21.15.119:0/3094300934 shutdown_connections 2024-03-08T21:35:21.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 --2- 172.21.15.119:0/3094300934 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52013f2c0 0x7ff52009a8d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 --2- 172.21.15.119:0/3094300934 >> v2:172.21.15.160:3300/0 conn(0x7ff520099ca0 0x7ff52013ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- 172.21.15.119:0/3094300934 >> 172.21.15.119:0/3094300934 conn(0x7ff52006c620 msgr2=0x7ff52006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- 172.21.15.119:0/3094300934 shutdown_connections 2024-03-08T21:35:21.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- 172.21.15.119:0/3094300934 wait complete. 2024-03-08T21:35:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 Processor -- start 2024-03-08T21:35:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.971+0000 7ff528000640 1 -- start start 2024-03-08T21:35:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff52009ae10 0x7ff5201364c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff52013f2c0 0x7ff520136a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5201522d0 con 0x7ff520099ca0 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff520152150 con 0x7ff52013f2c0 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff520152450 con 0x7ff52009ae10 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50420/0 (socket says 172.21.15.119:50420) 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 -- 172.21.15.119:0/4110766865 learned_addr learned my addr 172.21.15.119:0/4110766865 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff524c00640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff52009ae10 0x7ff5201364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff526000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff52013f2c0 0x7ff520136a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 -- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff52009ae10 msgr2=0x7ff5201364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff52009ae10 0x7ff5201364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 -- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff52013f2c0 msgr2=0x7ff520136a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff52013f2c0 0x7ff520136a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 -- 172.21.15.119:0/4110766865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52013aba0 con 0x7ff520099ca0 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff525600640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c7c0 tx=0x7ff51400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514007a30 con 0x7ff520099ca0 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff514007bd0 con 0x7ff520099ca0 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5140113f0 con 0x7ff520099ca0 2024-03-08T21:35:21.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52013c940 con 0x7ff520099ca0 2024-03-08T21:35:21.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff520139c50 con 0x7ff520099ca0 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52013ae80 con 0x7ff520099ca0 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.975+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 87083+0+0 (secure 0 0 0) 0x7ff5140115b0 con 0x7ff520099ca0 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.979+0000 7ff51d600640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 0x7ff500069b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.979+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff5140858a0 con 0x7ff520099ca0 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.979+0000 7ff524c00640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 0x7ff500069b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T21:35:21.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.979+0000 7ff524c00640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 0x7ff500069b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0ae000 tx=0x7ff50c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T21:35:21.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:21.983+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176605 (secure 0 0 0) 0x7ff52013ae80 con 0x7ff520099ca0 2024-03-08T21:35:22.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.167+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff520067db0 con 0x7ff520099ca0 2024-03-08T21:35:22.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.167+0000 7ff51d600640 1 -- 172.21.15.119:0/4110766865 <== mon.0 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2117 (secure 0 0 0) 0x7ff514015020 con 0x7ff520099ca0 2024-03-08T21:35:22.159 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-03-08T21:35:22.159 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/548180333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":548180333},{"type":"v1","addr":"172.21.15.160:6833","nonce":548180333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/503644204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":503644204},{"type":"v1","addr":"172.21.15.119:6835","nonce":503644204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2024-03-08T21:35:22.159 INFO:teuthology.orchestra.run.smithi119.stderr:dumped fsmap epoch 19 2024-03-08T21:35:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 msgr2=0x7ff500069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 0x7ff500069b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0ae000 tx=0x7ff50c0a7000 comp rx=0 tx=0).stop 2024-03-08T21:35:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 msgr2=0x7ff52013c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T21:35:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c7c0 tx=0x7ff51400cc80 comp rx=0 tx=0).stop 2024-03-08T21:35:22.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 shutdown_connections 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:6832/3371077572,v1:172.21.15.119:6833/3371077572] conn(0x7ff500067660 0x7ff500069b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff52013f2c0 0x7ff520136a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff52009ae10 0x7ff5201364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 --2- 172.21.15.119:0/4110766865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff520099ca0 0x7ff52013c400 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 >> 172.21.15.119:0/4110766865 conn(0x7ff52006c620 msgr2=0x7ff520072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 shutdown_connections 2024-03-08T21:35:22.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-03-08T21:35:22.171+0000 7ff528000640 1 -- 172.21.15.119:0/4110766865 wait complete. 2024-03-08T21:35:22.179 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-08T21:35:22.179 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-08T21:35:22.179 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-08T21:35:22.180 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.193 INFO:tasks.ceph.mds.a:Stopped 2024-03-08T21:35:22.193 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-08T21:35:22.193 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.208 INFO:tasks.ceph.mds.b:Stopped 2024-03-08T21:35:22.209 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-08T21:35:22.209 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-08T21:35:22.209 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.305 INFO:tasks.ceph.osd.0:Stopped 2024-03-08T21:35:22.306 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-08T21:35:22.306 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.398 INFO:tasks.ceph.osd.1:Stopped 2024-03-08T21:35:22.398 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-08T21:35:22.398 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.470 INFO:tasks.ceph.osd.2:Stopped 2024-03-08T21:35:22.470 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-08T21:35:22.470 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.545 INFO:tasks.ceph.osd.3:Stopped 2024-03-08T21:35:22.546 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-08T21:35:22.546 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:22.626 INFO:tasks.ceph.osd.4:Stopped 2024-03-08T21:35:22.626 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-08T21:35:22.626 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:25.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-08T21:35:28.728 INFO:tasks.ceph.osd.5:Stopped 2024-03-08T21:35:28.729 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-08T21:35:28.729 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:28.804 INFO:tasks.ceph.osd.6:Stopped 2024-03-08T21:35:28.805 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-08T21:35:28.805 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:28.882 INFO:tasks.ceph.osd.7:Stopped 2024-03-08T21:35:28.883 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-08T21:35:28.883 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-08T21:35:28.883 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:28.940 INFO:tasks.ceph.mgr.y:Stopped 2024-03-08T21:35:28.941 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-08T21:35:28.941 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:28.994 INFO:tasks.ceph.mgr.x:Stopped 2024-03-08T21:35:28.994 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-08T21:35:28.994 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-08T21:35:28.995 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:29.013 INFO:tasks.ceph.mon.a:Stopped 2024-03-08T21:35:29.013 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-08T21:35:29.013 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:29.030 INFO:tasks.ceph.mon.b:Stopped 2024-03-08T21:35:29.030 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-08T21:35:29.030 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T21:35:29.092 INFO:tasks.ceph.mon.c:Stopped 2024-03-08T21:35:29.092 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-08T21:35:29.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-08T21:35:29.124 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:35:29.125 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-08T21:35:29.484 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:35:29.484 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-08T21:35:29.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:35:29.688 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-08T21:35:29.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:35:29.854 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-08T21:35:30.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:35:30.020 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-08T21:35:30.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:35:30.225 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-08T21:35:30.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:35:30.448 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-08T21:35:30.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:35:30.614 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-08T21:35:30.781 INFO:tasks.ceph:Archiving mon data... 2024-03-08T21:35:30.783 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/data/mon.a.tgz 2024-03-08T21:35:30.783 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-03-08T21:35:30.792 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.Mu7jPv2MlS 2024-03-08T21:35:30.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Mu7jPv2MlS 2024-03-08T21:35:30.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-08T21:35:30.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.Mu7jPv2MlS 2024-03-08T21:35:30.985 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.Mu7jPv2MlS is 273KB 2024-03-08T21:35:31.054 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.Mu7jPv2MlS 2024-03-08T21:35:31.063 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/data/mon.b.tgz 2024-03-08T21:35:31.064 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-03-08T21:35:31.073 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.6c3yOtT8LZ 2024-03-08T21:35:31.073 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6c3yOtT8LZ 2024-03-08T21:35:31.209 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.6c3yOtT8LZ 2024-03-08T21:35:31.284 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.6c3yOtT8LZ is 366KB 2024-03-08T21:35:31.351 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.6c3yOtT8LZ 2024-03-08T21:35:31.359 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/data/mon.c.tgz 2024-03-08T21:35:31.359 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-03-08T21:35:31.410 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.yZv2SExwuP 2024-03-08T21:35:31.411 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yZv2SExwuP 2024-03-08T21:35:31.540 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.yZv2SExwuP 2024-03-08T21:35:31.612 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.yZv2SExwuP is 366KB 2024-03-08T21:35:31.679 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.yZv2SExwuP 2024-03-08T21:35:31.687 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-08T21:35:31.687 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T21:35:31.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T21:35:31.759 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T21:35:31.800 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T21:35:31.800 INFO:tasks.ceph:Archiving crash dumps... 2024-03-08T21:35:31.802 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi119/crash 2024-03-08T21:35:31.803 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T21:35:31.828 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi160/crash 2024-03-08T21:35:31.829 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T21:35:31.857 INFO:tasks.ceph:Shutting down logrotate 2024-03-08T21:35:31.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:31.878 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:31.963 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:31.984 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T21:35:32.003 INFO:tasks.ceph:Compressing logs... 2024-03-08T21:35:32.003 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T21:35:32.030 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T21:35:32.051 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-03-08T21:35:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27384.log 2024-03-08T21:35:32.053 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2024-03-08T21:35:32.053 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-03-08T21:35:32.054 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.27384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-03-08T21:35:32.054 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27384.log.gz 2024-03-08T21:35:32.055 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32910.log 2024-03-08T21:35:32.055 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2024-03-08T21:35:32.056 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36606.log 2024-03-08T21:35:32.056 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-03-08T21:35:32.056 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36174.log 2024-03-08T21:35:32.057 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32910.log.gz 2024-03-08T21:35:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36122.log 2024-03-08T21:35:32.058 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36606.log.gz 2024-03-08T21:35:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-03-08T21:35:32.059 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36174.log.gz 2024-03-08T21:35:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2024-03-08T21:35:32.059 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36122.log.gz 2024-03-08T21:35:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-08T21:35:32.060 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-03-08T21:35:32.061 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-03-08T21:35:32.061 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2024-03-08T21:35:32.061 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-03-08T21:35:32.062 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-03-08T21:35:32.063 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz 2024-03-08T21:35:32.063 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36096.log 2024-03-08T21:35:32.063 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-03-08T21:35:32.064 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-03-08T21:35:32.064 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-03-08T21:35:32.065 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34072.log 2024-03-08T21:35:32.065 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36096.log.gz 2024-03-08T21:35:32.066 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37417.log 2024-03-08T21:35:32.066 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-03-08T21:35:32.067 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34072.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-08T21:35:32.067 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34072.log.gz 2024-03-08T21:35:32.068 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-03-08T21:35:32.068 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37417.log.gz 2024-03-08T21:35:32.068 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35103.log 2024-03-08T21:35:32.069 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35794.log 2024-03-08T21:35:32.069 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-03-08T21:35:32.070 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33292.log 2024-03-08T21:35:32.070 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35103.log.gz 2024-03-08T21:35:32.071 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-03-08T21:35:32.071 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35794.log.gz 2024-03-08T21:35:32.072 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35664.log 2024-03-08T21:35:32.072 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33292.log.gz 2024-03-08T21:35:32.073 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36450.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-03-08T21:35:32.073 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-03-08T21:35:32.074 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-03-08T21:35:32.075 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35664.log.gz 2024-03-08T21:35:32.075 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37162.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-03-08T21:35:32.075 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33877.log 2024-03-08T21:35:32.076 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-03-08T21:35:32.076 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-03-08T21:35:32.077 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-03-08T21:35:32.077 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33877.log.gz 2024-03-08T21:35:32.078 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-03-08T21:35:32.078 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-03-08T21:35:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35449.log 2024-03-08T21:35:32.079 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-03-08T21:35:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-03-08T21:35:32.081 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-03-08T21:35:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36872.log 2024-03-08T21:35:32.081 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35449.log.gz 2024-03-08T21:35:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-03-08T21:35:32.082 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-03-08T21:35:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36872.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-08T21:35:32.083 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36872.log.gz 2024-03-08T21:35:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36398.log 2024-03-08T21:35:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35233.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-03-08T21:35:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2024-03-08T21:35:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35501.log 2024-03-08T21:35:32.087 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36398.log.gz 2024-03-08T21:35:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37365.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz -5 2024-03-08T21:35:32.088 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34869.log 2024-03-08T21:35:32.089 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27541.log 2024-03-08T21:35:32.089 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27565.log 2024-03-08T21:35:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35501.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35501.log.gz 2024-03-08T21:35:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37767.log 2024-03-08T21:35:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32865.log 2024-03-08T21:35:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37767.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34869.log.gz 2024-03-08T21:35:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-03-08T21:35:32.093 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37767.log.gz 2024-03-08T21:35:32.094 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-08T21:35:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-03-08T21:35:32.094 INFO:teuthology.orchestra.run.smithi119.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32865.log.gz 2024-03-08T21:35:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37058.log 2024-03-08T21:35:32.094 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27541.log: /var/log/ceph/ceph-client.admin.27565.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27541.log.gz 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27661.log 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27565.log.gz 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27613.log 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27661.log.gz 2024-03-08T21:35:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27589.log 2024-03-08T21:35:32.097 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27613.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-08T21:35:32.097 INFO:teuthology.orchestra.run.smithi160.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27613.log.gz 2024-03-08T21:35:32.097 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27493.log 2024-03-08T21:35:32.097 INFO:teuthology.orchestra.run.smithi160.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27589.log.gz 2024-03-08T21:35:32.097 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27517.log 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27493.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27493.log.gz 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27517.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27517.log.gz 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-08T21:35:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27637.log 2024-03-08T21:35:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-03-08T21:35:32.104 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-03-08T21:35:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35532.log 2024-03-08T21:35:32.104 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37058.log.gz 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35532.log.gz 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34643.log 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35051.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-08T21:35:32.105 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.34643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37339.log 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.a.log: 89.2% -- replaced with /var/log/ceph/ceph-client.0.34643.log.gz 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36789.log 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37339.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37339.log.gz 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37793.log 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:gzip/var/log/ceph/ceph-client.0.36789.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-03-08T21:35:32.106 INFO:teuthology.orchestra.run.smithi119.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37793.log.gz 2024-03-08T21:35:32.107 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.27637.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27637.log.gz 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-08T21:35:32.108 INFO:teuthology.orchestra.run.smithi160.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T21:35:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34973.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-03-08T21:35:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35397.log 2024-03-08T21:35:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36924.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.36789.log.gz 2024-03-08T21:35:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34436.log 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35397.log.gz 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33667.log 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34436.log.gz 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38030.log 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34098.log: /var/log/ceph/ceph-client.admin.33667.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gz 2024-03-08T21:35:32.112 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33667.log.gz 2024-03-08T21:35:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34176.log 2024-03-08T21:35:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:gzip/var/log/ceph/ceph-client.admin.38030.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36070.log 2024-03-08T21:35:32.114 INFO:teuthology.orchestra.run.smithi119.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2024-03-08T21:35:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34947.log 2024-03-08T21:35:32.114 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34176.log.gz 2024-03-08T21:35:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-03-08T21:35:32.115 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36070.log.gz 2024-03-08T21:35:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-03-08T21:35:32.116 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34947.log.gz 2024-03-08T21:35:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36842.log 2024-03-08T21:35:32.116 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-03-08T21:35:32.117 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35318.log 2024-03-08T21:35:32.117 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-03-08T21:35:32.118 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37923.log 2024-03-08T21:35:32.119 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36842.log: /var/log/ceph/ceph-client.admin.35318.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36842.log.gz 2024-03-08T21:35:32.119 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-03-08T21:35:32.119 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35318.log.gz 2024-03-08T21:35:32.120 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34462.log 2024-03-08T21:35:32.120 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37923.log.gz 2024-03-08T21:35:32.121 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-03-08T21:35:32.121 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-03-08T21:35:32.122 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2024-03-08T21:35:32.122 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34462.log.gz 2024-03-08T21:35:32.123 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36343.log 2024-03-08T21:35:32.123 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-03-08T21:35:32.124 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2024-03-08T21:35:32.124 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-03-08T21:35:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-03-08T21:35:32.125 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36343.log: /var/log/ceph/ceph-client.admin.35129.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36343.log.gz 2024-03-08T21:35:32.126 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-03-08T21:35:32.126 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37391.log 2024-03-08T21:35:32.127 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34791.log 2024-03-08T21:35:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35865.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-03-08T21:35:32.128 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35475.log 2024-03-08T21:35:32.129 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37391.log.gz 2024-03-08T21:35:32.129 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34791.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-08T21:35:32.129 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34791.log.gz 2024-03-08T21:35:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-03-08T21:35:32.130 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.3.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35475.log.gz 2024-03-08T21:35:32.131 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32768.log 2024-03-08T21:35:32.132 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34306.log 2024-03-08T21:35:32.133 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-03-08T21:35:32.133 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-03-08T21:35:32.134 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32768.log.gz 2024-03-08T21:35:32.135 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log 2024-03-08T21:35:32.135 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34306.log.gz 2024-03-08T21:35:32.136 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-03-08T21:35:32.136 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-03-08T21:35:32.136 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-03-08T21:35:32.137 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz 2024-03-08T21:35:32.138 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35891.log 2024-03-08T21:35:32.138 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-03-08T21:35:32.139 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-03-08T21:35:32.139 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-03-08T21:35:32.140 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34280.log 2024-03-08T21:35:32.140 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35891.log.gz 2024-03-08T21:35:32.141 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33665.log 2024-03-08T21:35:32.141 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-03-08T21:35:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33671.log 2024-03-08T21:35:32.143 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34280.log.gz 2024-03-08T21:35:32.143 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2024-03-08T21:35:32.144 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33665.log.gz 2024-03-08T21:35:32.145 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34843.log 2024-03-08T21:35:32.145 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-03-08T21:35:32.146 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34895.log 2024-03-08T21:35:32.146 INFO:teuthology.orchestra.run.smithi119.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2024-03-08T21:35:32.147 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37871.log 2024-03-08T21:35:32.148 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34843.log.gz 2024-03-08T21:35:32.148 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-03-08T21:35:32.149 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34895.log.gz 2024-03-08T21:35:32.150 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38006.log 2024-03-08T21:35:32.150 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37871.log.gz 2024-03-08T21:35:32.151 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-03-08T21:35:32.151 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-03-08T21:35:32.152 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.38006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-03-08T21:35:32.152 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38006.log.gz 2024-03-08T21:35:32.153 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34817.log 2024-03-08T21:35:32.153 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-03-08T21:35:32.154 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-03-08T21:35:32.154 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-03-08T21:35:32.155 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32835.log 2024-03-08T21:35:32.155 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34817.log.gz 2024-03-08T21:35:32.156 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33160.log 2024-03-08T21:35:32.157 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-03-08T21:35:32.158 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-03-08T21:35:32.158 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32835.log.gz 2024-03-08T21:35:32.159 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-03-08T21:35:32.159 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33160.log.gz 2024-03-08T21:35:32.160 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-08T21:35:32.160 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-03-08T21:35:32.161 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-03-08T21:35:32.161 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-03-08T21:35:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33396.log 2024-03-08T21:35:32.163 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33892.log 2024-03-08T21:35:32.164 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-08T21:35:32.164 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33396.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-03-08T21:35:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-03-08T21:35:32.165 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33396.log.gz 2024-03-08T21:35:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35690.log 2024-03-08T21:35:32.166 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33892.log.gz 2024-03-08T21:35:32.166 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37637.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-03-08T21:35:32.167 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33888.log 2024-03-08T21:35:32.167 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37819.log 2024-03-08T21:35:32.168 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35690.log.gz 2024-03-08T21:35:32.169 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37975.log 2024-03-08T21:35:32.169 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33888.log.gz 2024-03-08T21:35:32.170 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37897.log 2024-03-08T21:35:32.170 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37819.log.gz 2024-03-08T21:35:32.171 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36369.log 2024-03-08T21:35:32.171 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37975.log.gz 2024-03-08T21:35:32.172 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35370.log 2024-03-08T21:35:32.172 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37897.log.gz 2024-03-08T21:35:32.173 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2024-03-08T21:35:32.173 INFO:teuthology.orchestra.run.smithi119.stderr: 93.8% 89.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36369.log.gz 2024-03-08T21:35:32.174 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-03-08T21:35:32.174 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37006.log 2024-03-08T21:35:32.174 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35370.log.gz 2024-03-08T21:35:32.175 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33318.log: -- /var/log/ceph/ceph-client.admin.34410.log 2024-03-08T21:35:32.175 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2024-03-08T21:35:32.176 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36976.log 2024-03-08T21:35:32.176 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37006.log.gz 2024-03-08T21:35:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37032.log 2024-03-08T21:35:32.177 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34410.log.gz 2024-03-08T21:35:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-03-08T21:35:32.178 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36976.log.gz 2024-03-08T21:35:32.179 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-03-08T21:35:32.179 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37032.log.gz 2024-03-08T21:35:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33015.log 2024-03-08T21:35:32.180 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-03-08T21:35:32.180 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37136.log 2024-03-08T21:35:32.181 INFO:teuthology.orchestra.run.smithi119.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-03-08T21:35:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34358.log 2024-03-08T21:35:32.182 INFO:teuthology.orchestra.run.smithi119.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33015.log.gz 2024-03-08T21:35:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33476.log 2024-03-08T21:35:32.183 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37136.log.gz 2024-03-08T21:35:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2024-03-08T21:35:32.184 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34358.log.gz 2024-03-08T21:35:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37663.log 2024-03-08T21:35:32.185 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33476.log.gz 2024-03-08T21:35:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-08T21:35:32.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35610.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T21:35:32.187 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2024-03-08T21:35:32.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33041.log 2024-03-08T21:35:32.187 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37663.log.gz 2024-03-08T21:35:32.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33471.log 2024-03-08T21:35:32.188 INFO:teuthology.orchestra.run.smithi119.stderr: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-08T21:35:32.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27619.log 2024-03-08T21:35:32.189 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33041.log.gz 2024-03-08T21:35:32.189 INFO:teuthology.orchestra.run.smithi160.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-08T21:35:32.190 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-03-08T21:35:32.190 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33471.log.gz 2024-03-08T21:35:32.190 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.27619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37533.log 2024-03-08T21:35:32.191 INFO:teuthology.orchestra.run.smithi160.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-08T21:35:32.192 INFO:teuthology.orchestra.run.smithi119.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27619.log.gz 2024-03-08T21:35:32.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34228.log 2024-03-08T21:35:32.192 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-03-08T21:35:32.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35423.log 2024-03-08T21:35:32.193 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37533.log.gz 2024-03-08T21:35:32.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33879.log 2024-03-08T21:35:32.194 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34228.log.gz 2024-03-08T21:35:32.194 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37741.log 2024-03-08T21:35:32.195 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35423.log: /var/log/ceph/ceph-client.admin.33879.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35423.log.gz 2024-03-08T21:35:32.195 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33879.log.gz 2024-03-08T21:35:32.195 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2024-03-08T21:35:32.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2024-03-08T21:35:32.196 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37741.log.gz 2024-03-08T21:35:32.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36734.log 2024-03-08T21:35:32.197 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2024-03-08T21:35:32.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33344.log 2024-03-08T21:35:32.198 INFO:teuthology.orchestra.run.smithi119.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 2024-03-08T21:35:32.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-03-08T21:35:32.199 INFO:teuthology.orchestra.run.smithi160.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-08T21:35:32.200 INFO:teuthology.orchestra.run.smithi119.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36734.log.gz 2024-03-08T21:35:32.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35716.log 2024-03-08T21:35:32.200 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33344.log.gz 2024-03-08T21:35:32.201 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34124.log 2024-03-08T21:35:32.201 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-03-08T21:35:32.202 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37559.log 2024-03-08T21:35:32.202 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35716.log.gz 2024-03-08T21:35:32.203 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37084.log 2024-03-08T21:35:32.203 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34124.log.gz 2024-03-08T21:35:32.204 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33684.log 2024-03-08T21:35:32.204 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37559.log.gz 2024-03-08T21:35:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33212.log 2024-03-08T21:35:32.205 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37084.log.gz 2024-03-08T21:35:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36226.log 2024-03-08T21:35:32.206 INFO:teuthology.orchestra.run.smithi119.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33684.log.gz 2024-03-08T21:35:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33212.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22575.log 2024-03-08T21:35:32.207 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33212.log.gz 2024-03-08T21:35:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33458.log 2024-03-08T21:35:32.208 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36226.log.gz 2024-03-08T21:35:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.tmp-client.admin.22575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-03-08T21:35:32.208 INFO:teuthology.orchestra.run.smithi119.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22575.log.gz 2024-03-08T21:35:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34384.log 2024-03-08T21:35:32.209 INFO:teuthology.orchestra.run.smithi119.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33458.log.gz 2024-03-08T21:35:32.210 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-08T21:35:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35920.log 2024-03-08T21:35:32.211 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-03-08T21:35:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-03-08T21:35:32.211 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34384.log.gz 2024-03-08T21:35:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35920.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T21:35:32.212 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35920.log.gz 2024-03-08T21:35:32.213 INFO:teuthology.orchestra.run.smithi160.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-08T21:35:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33474.log 2024-03-08T21:35:32.214 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-03-08T21:35:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-08T21:35:32.216 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-03-08T21:35:32.216 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m0.164s 2024-03-08T21:35:32.216 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m0.560s 2024-03-08T21:35:32.216 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.111s 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33474.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34202.log 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33474.log.gz 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34202.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34202.log.gz 2024-03-08T21:35:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-03-08T21:35:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-03-08T21:35:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37190.log: /var/log/ceph/ceph-client.admin.35768.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-03-08T21:35:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37481.log 2024-03-08T21:35:32.219 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-03-08T21:35:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-03-08T21:35:32.220 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-03-08T21:35:32.221 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-03-08T21:35:32.221 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37481.log.gz 2024-03-08T21:35:32.222 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33887.log 2024-03-08T21:35:32.222 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-03-08T21:35:32.223 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37110.log 2024-03-08T21:35:32.223 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-03-08T21:35:32.224 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36317.log 2024-03-08T21:35:32.224 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33887.log.gz 2024-03-08T21:35:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37110.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.37110.log.gz -5 2024-03-08T21:35:32.225 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35344.log 2024-03-08T21:35:32.230 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37845.log 2024-03-08T21:35:32.231 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36317.log.gz 2024-03-08T21:35:32.231 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37507.log 2024-03-08T21:35:32.231 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35344.log.gz 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37845.log.gz 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35742.log 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37507.log.gz 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33680.log 2024-03-08T21:35:32.232 INFO:teuthology.orchestra.run.smithi119.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-03-08T21:35:32.233 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34517.log 2024-03-08T21:35:32.234 INFO:teuthology.orchestra.run.smithi119.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35742.log.gz 2024-03-08T21:35:32.234 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36254.log 2024-03-08T21:35:32.234 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33680.log.gz 2024-03-08T21:35:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-03-08T21:35:32.235 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34517.log.gz 2024-03-08T21:35:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37949.log 2024-03-08T21:35:32.235 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36254.log.gz 2024-03-08T21:35:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36424.log 2024-03-08T21:35:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37294.log: 87.5%/var/log/ceph/ceph-client.admin.37949.log: -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-03-08T21:35:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33370.log 2024-03-08T21:35:32.237 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37949.log.gz 2024-03-08T21:35:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37585.log 88.8% 2024-03-08T21:35:32.238 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36424.log.gz 2024-03-08T21:35:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-03-08T21:35:32.239 INFO:teuthology.orchestra.run.smithi119.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33370.log.gz 2024-03-08T21:35:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2024-03-08T21:35:32.240 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37585.log.gz 2024-03-08T21:35:32.241 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.35822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-03-08T21:35:32.241 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-03-08T21:35:32.242 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-03-08T21:35:32.242 INFO:teuthology.orchestra.run.smithi119.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2024-03-08T21:35:32.243 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-03-08T21:35:32.243 INFO:teuthology.orchestra.run.smithi119.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-03-08T21:35:32.244 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-03-08T21:35:32.244 INFO:teuthology.orchestra.run.smithi119.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-03-08T21:35:32.245 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36200.log 2024-03-08T21:35:32.247 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.38056.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-03-08T21:35:32.247 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33240.log 2024-03-08T21:35:32.247 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-03-08T21:35:32.247 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-03-08T21:35:32.248 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36200.log.gz 2024-03-08T21:35:32.248 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-03-08T21:35:32.249 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33240.log.gz 2024-03-08T21:35:32.249 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34921.log 2024-03-08T21:35:32.249 INFO:teuthology.orchestra.run.smithi119.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-03-08T21:35:32.250 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27501.log 2024-03-08T21:35:32.251 INFO:teuthology.orchestra.run.smithi119.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-03-08T21:35:32.251 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-08T21:35:32.252 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33266.log 2024-03-08T21:35:32.252 INFO:teuthology.orchestra.run.smithi119.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34921.log.gz 2024-03-08T21:35:32.252 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.27501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2024-03-08T21:35:32.253 INFO:teuthology.orchestra.run.smithi119.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27501.log.gz 2024-03-08T21:35:32.253 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.33266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32963.log 2024-03-08T21:35:32.253 INFO:teuthology.orchestra.run.smithi119.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33266.log.gz 2024-03-08T21:35:32.254 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36502.log 2024-03-08T21:35:32.254 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2024-03-08T21:35:32.255 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.32963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32963.log.gz 2024-03-08T21:35:32.255 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.36502.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36502.log.gz 2024-03-08T21:35:32.272 INFO:teuthology.orchestra.run.smithi119.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-08T21:35:32.275 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-08T21:35:32.285 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-08T21:35:32.288 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-03-08T21:35:32.288 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.254s 2024-03-08T21:35:32.288 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m0.888s 2024-03-08T21:35:32.288 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.356s 2024-03-08T21:35:32.289 INFO:tasks.ceph:Archiving logs... 2024-03-08T21:35:32.290 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi119/log 2024-03-08T21:35:32.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T21:35:32.575 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi160/log 2024-03-08T21:35:32.576 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T21:35:32.677 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-08T21:35:32.692 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-08T21:35:32.693 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T21:35:32.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T21:35:32.770 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-08T21:35:32.780 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-08T21:35:32.781 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T21:35:32.784 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T21:35:32.794 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-03-08T21:35:32.795 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-03-08T21:35:32.795 INFO:teuthology.orchestra.run.smithi119.stdout:*hv01.front.sepi 44.4.53.2 2 u 1 64 77 0.073 +0.735 3.207 2024-03-08T21:35:32.795 INFO:teuthology.orchestra.run.smithi119.stdout:+hv02.front.sepi 96.245.170.99 3 u 1 64 77 0.052 +1.889 3.281 2024-03-08T21:35:32.795 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 1 64 77 0.080 -2.026 3.013 2024-03-08T21:35:32.795 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:35:32.798 INFO:teuthology.orchestra.run.smithi160.stdout: remote refid st t when poll reach delay offset jitter 2024-03-08T21:35:32.799 INFO:teuthology.orchestra.run.smithi160.stdout:============================================================================== 2024-03-08T21:35:32.799 INFO:teuthology.orchestra.run.smithi160.stdout:*hv01.front.sepi 44.4.53.2 2 u 6 64 77 0.083 +0.984 2.204 2024-03-08T21:35:32.799 INFO:teuthology.orchestra.run.smithi160.stdout:+hv02.front.sepi 96.245.170.99 3 u 3 64 77 0.089 -0.759 1.741 2024-03-08T21:35:32.799 INFO:teuthology.orchestra.run.smithi160.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 77 0.114 -1.779 2.046 2024-03-08T21:35:32.799 INFO:teuthology.orchestra.run.smithi160.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-08T21:35:32.800 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-08T21:35:32.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-08T21:35:32.810 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-08T21:35:32.818 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-08T21:35:32.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-08T21:35:32.845 INFO:teuthology.task.internal:Duration was 798.002225 seconds 2024-03-08T21:35:32.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-08T21:35:32.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-08T21:35:32.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T21:35:32.858 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T21:35:32.941 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-08T21:35:32.941 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-03-08T21:35:32.942 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T21:35:32.961 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-03-08T21:35:32.961 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T21:35:32.982 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-08T21:35:32.982 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T21:35:33.006 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T21:35:33.064 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-08T21:35:33.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T21:35:33.086 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T21:35:33.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-08T21:35:33.494 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-08T21:35:33.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T21:35:33.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T21:35:33.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-08T21:35:33.814 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T21:35:33.818 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T21:35:33.833 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-03-08T21:35:33.836 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-03-08T21:35:33.865 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T21:35:33.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:35:33.907 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T21:35:33.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T21:35:33.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-08T21:35:33.965 INFO:teuthology.task.internal:Transferring archived files... 2024-03-08T21:35:33.965 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi119 2024-03-08T21:35:33.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T21:35:34.016 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173/remote/smithi160 2024-03-08T21:35:34.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T21:35:34.113 INFO:teuthology.task.internal:Removing archive directory... 2024-03-08T21:35:34.114 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T21:35:34.117 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T21:35:34.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-08T21:35:34.871 INFO:teuthology.task.internal:Not uploading archives. 2024-03-08T21:35:34.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-08T21:35:35.535 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-08T21:35:35.535 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T21:35:35.539 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T21:35:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: 658113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 21:35 /home/ubuntu/cephtest 2024-03-08T21:35:35.549 INFO:teuthology.orchestra.run.smithi160.stdout: 658113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 21:35 /home/ubuntu/cephtest 2024-03-08T21:35:35.551 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-08T21:35:35.896 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-08T21:35:36.091 INFO:teuthology.nuke:Checking targets against current locks 2024-03-08T21:35:36.117 DEBUG:teuthology.nuke:shortname: smithi119 2024-03-08T21:35:36.117 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T21:35:36.143 DEBUG:teuthology.nuke:shortname: smithi160 2024-03-08T21:35:36.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T21:35:36.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 21:03:44.971905', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFzhmpaqx9Ga6rr4MqgFLMzouG7pygibGhHYEDeobfgzfDup8t2qKYmiGVgy7ah0fFosDEn+ex7uSea0vKL6J0='} 2024-03-08T21:35:36.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588173', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 21:03:44.969949', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOg+bOf8gOAeVh18+183N9yHnU2HFfayfIdeaJaw8iBQSBziEoIdoooAdK/KszCtLUFyHk7L/7dQ++kzyXcIdNI='} 2024-03-08T21:35:36.203 INFO:teuthology.orchestra.console.smithi119:Power off 2024-03-08T21:35:36.203 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T21:35:36.228 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-03-08T21:35:36.228 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:36.244 INFO:teuthology.orchestra.console.smithi160:Power off 2024-03-08T21:35:36.245 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T21:35:36.256 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-08T21:35:36.269 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-03-08T21:35:36.269 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:36.293 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-03-08T21:35:40.257 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:40.294 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:40.368 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-03-08T21:35:40.405 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-03-08T21:35:44.373 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:44.406 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:44.485 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-03-08T21:35:44.520 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-03-08T21:35:44.586 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-03-08T21:35:48.523 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T21:35:48.635 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-03-08T21:35:48.736 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-03-08T21:35:48.841 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} duration: 798.0022246837616 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default mon.a-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 mon.b-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=860856364f0c489fb84fc84e6b2643da status: fail success: false 2024-03-08T21:35:48.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T21:35:48.929 INFO:teuthology.run:FAIL